-- Logs begin at Sat 2022-10-01 03:38:53 UTC, end at Sat 2022-10-01 04:38:42 UTC. -- Oct 01 04:03:16.898787 dv-cinder-860044-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 01 04:03:16.908043 dv-cinder-860044-1-smb devstack@keystone.service[81710]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 1 04:03:16 2022] *** Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: nodename: dv-cinder-860044-1-smb Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: machine: x86_64 Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: clock source: unix Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: pcre jit disabled Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: detected number of CPU cores: 4 Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: current working directory: / Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: detected binary path: /usr/bin/uwsgi-core Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: your processes number limit is 47680 Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: your memory page size is 4096 bytes Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: detected max file descriptor number: 2048 Oct 01 04:03:16.910062 dv-cinder-860044-1-smb devstack@keystone.service[81710]: lock engine: pthread robust mutexes Oct 01 04:03:16.910950 dv-cinder-860044-1-smb devstack@keystone.service[81710]: thunder lock: enabled Oct 01 04:03:16.910950 dv-cinder-860044-1-smb devstack@keystone.service[81710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 01 04:03:16.910950 dv-cinder-860044-1-smb devstack@keystone.service[81710]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 01 04:03:16.949385 dv-cinder-860044-1-smb devstack@keystone.service[81710]: Python main interpreter initialized at 0x55f3c09e39c0 Oct 01 04:03:16.949385 dv-cinder-860044-1-smb devstack@keystone.service[81710]: python threads support enabled Oct 01 04:03:16.949385 dv-cinder-860044-1-smb devstack@keystone.service[81710]: your server socket listen backlog is limited to 100 connections Oct 01 04:03:16.949385 dv-cinder-860044-1-smb devstack@keystone.service[81710]: your mercy for graceful operations on workers is 90 seconds Oct 01 04:03:16.949715 dv-cinder-860044-1-smb devstack@keystone.service[81710]: mapped 403077 bytes (393 KB) for 2 cores Oct 01 04:03:16.949795 dv-cinder-860044-1-smb devstack@keystone.service[81710]: *** Operational MODE: preforking *** Oct 01 04:03:16.950059 dv-cinder-860044-1-smb devstack@keystone.service[81710]: *** uWSGI is running in multiple interpreter mode *** Oct 01 04:03:16.950059 dv-cinder-860044-1-smb devstack@keystone.service[81710]: spawned uWSGI master process (pid: 81710) Oct 01 04:03:16.950244 dv-cinder-860044-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 01 04:03:16.951570 dv-cinder-860044-1-smb devstack@keystone.service[81710]: spawned uWSGI worker 1 (pid: 81720, cores: 1) Oct 01 04:03:16.951570 dv-cinder-860044-1-smb devstack@keystone.service[81710]: spawned uWSGI worker 2 (pid: 81721, cores: 1) Oct 01 04:03:16.951570 dv-cinder-860044-1-smb devstack@keystone.service[81710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 01 04:03:21.199574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:03:21.199574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: from cryptography.utils import int_from_bytes Oct 01 04:03:21.200359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:03:21.200359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: from cryptography.utils import int_from_bytes Oct 01 04:03:21.200359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:03:21.200359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: from cryptography.utils import int_from_bytes Oct 01 04:03:21.200860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:03:21.200860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: from cryptography.utils import int_from_bytes Oct 01 04:03:21.249981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 04:03:21.250141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 04:03:21.250230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 04:03:21.250319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 04:03:21.250396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] command line args: [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 04:03:21.250461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] command line args: [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 04:03:21.250615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 04:03:21.250713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 04:03:21.250792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ================================================================================ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 04:03:21.250864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ================================================================================ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 04:03:21.251038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] admin_token = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] admin_token = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_dir = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config_dir = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_source = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] config_source = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] debug = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.251904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] debug = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.252934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_config_append = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_config_append = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.253943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_dir = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_dir = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.254999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.255963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.256989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.257151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.257275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.257426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.257560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.257911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.257990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] publish_errors = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] publish_errors = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.258941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] standard_threads = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] standard_threads = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.259971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_journal = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_journal = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_json = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_json = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_stderr = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_stderr = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_syslog = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] use_syslog = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.260974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.261045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:03:21.261207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.261286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.261447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.261533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.261706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.261786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.261947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.262914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.263743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.264434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.264522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.264690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.264769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.264929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.265997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.266968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.267998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.268927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.269878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.270990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.271917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.272967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.273904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.274856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.275983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.276970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.277952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.278937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.279090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.279171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.279326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.279408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.279585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.279681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.280383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.280481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.280637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.280720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.280880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.280998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.281939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.282882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.283878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.284849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.285947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.286974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.287994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.external = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.external = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.288999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.password = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.password = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.token = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] auth.token = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.289905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.290887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.291846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.292992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.293975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.294847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.295006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.295089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.295795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.295879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.296870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.297989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.298965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.299921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.300975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.301950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.302870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.303997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.304941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.305875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.306933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.307868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.308884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.309934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.310064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.310200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.310342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.310484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.310615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.310745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.311449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.311588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.311734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.311872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.312891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.313881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.314995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.315995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.316983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.317945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.318905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.319874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.320926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.321898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.322875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.323991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.324975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.325934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.326145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.326284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.326462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.326600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.326736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.326883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.327851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.328917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.329882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.330873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.331840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.332993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.333956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.334921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.335894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.336925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.337905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.338870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.339999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.340142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.340300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.340449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.340596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.340734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.340871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.341869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.342866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.343999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.344217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.344376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.344557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.344698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.344861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.345903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 04:03:21.346723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:03:21.346723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 04:03:21.368994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.369209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.369369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.369505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.369638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.369770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.378386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.378692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.407625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.407846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.408147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.408384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.461124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.461483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.510403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.510632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.510996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.511234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.666530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.666794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.666933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.667854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.668023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.668107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.690803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.691996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.692130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.692211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.692412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.703286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.703757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.715893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.716870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.717512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.717610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.717730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.717812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.717945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.718163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81721) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 01 04:03:21.734890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.735100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 04:03:21.735216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.735431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 04:03:21.735512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.735631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 04:03:21.735778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.735909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.736011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 01 04:03:21.736207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.736287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.736468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.736551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.736725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.736806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.737032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.746229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.746511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.746600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.746782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.746863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.747063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.747153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.747392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.754041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.754392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.756946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.757233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.757340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.757523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.757632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.757810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.757922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.758903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.759890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.760190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.783178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.783629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.784667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.784951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.785129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.785426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.789604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.789894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.790085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.790167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.790377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.790666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.797076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.797358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.797784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.798081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.802938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.803243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.803541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.806156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.806672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.820260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.820540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.820998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.821278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.824348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.825097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.827567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.827865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.828268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.828561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.832035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.832704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.835095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.835775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.838287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.838590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.838874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.838957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.839157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.839240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.839435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.839518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.839714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.839796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.840051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.840333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.855847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.856163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.856360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.856445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.856650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.856747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.856916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.857178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.864095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.864645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.865648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.866188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.867175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.867461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.867701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.868001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.870458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.870748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.870830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.871033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.871115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.871314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.871396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.871594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.871684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.872001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.882876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.883164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.883324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.883446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.883607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.883727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.883885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.884132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.884215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.884414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.884563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.884693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.884851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.885130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.900871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.901182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.903785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.904088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.907228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.907529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.908726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.909112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.910312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.910598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.910722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.911011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.911106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.911412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.917375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.917741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.918830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.919187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.921773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.922117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.922201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.922443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.922525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.922725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.922808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.923050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.930531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.930815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.930914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.931105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.931187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.931394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.938089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.938263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81721) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 01 04:03:21.938375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.938549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.938656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.938831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.938939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.939966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.940886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.941889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81721) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 01 04:03:21.976494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3c09e39c0 pid: 81720 (default app) Oct 01 04:03:21.976692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3c09e39c0 pid: 81721 (default app) Oct 01 04:03:21.979708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e215ad0-2413-4ea6-90a0-9baae1652c00 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:21.980019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e215ad0-2413-4ea6-90a0-9baae1652c00 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:21.980296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e215ad0-2413-4ea6-90a0-9baae1652c00 None None] PATH_INFO: `/v3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:21.984465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Sat Oct 1 04:03:21 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:28.678981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aaa16-7403-4121-9773-017e56557216 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:28.679489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aaa16-7403-4121-9773-017e56557216 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:28.679594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aaa16-7403-4121-9773-017e56557216 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:28.683748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:03:28.689904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:28.690348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:28.690486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:28.760317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: INFO dbcounter [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] Registered counter for database keystone Oct 01 04:03:28.779604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG oslo_db.sqlalchemy.engines [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:03:28.785746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writer thread running {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:03:28.963305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG passlib.handlers.bcrypt [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81720) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 01 04:03:28.963606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG passlib.handlers.bcrypt [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81720) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 01 04:03:29.020934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:29.022764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:29.148165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 01 04:03:29.628764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aaa16-7403-4121-9773-017e56557216 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:29.699483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: INFO dbcounter [None req-610aaa16-7403-4121-9773-017e56557216 None None] Registered counter for database keystone Oct 01 04:03:29.721786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG oslo_db.sqlalchemy.engines [None req-610aaa16-7403-4121-9773-017e56557216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:03:29.727915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writer thread running {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:03:29.846120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aaa16-7403-4121-9773-017e56557216 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:29.850407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:29.851038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:29.851322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:29.851597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:29.860289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:29.910634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 01 04:03:29.910925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde50d-cc2a-41ca-9f5f-64f86ba24aaf admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:29.920270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Sat Oct 1 04:03:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 01 04:03:29.926110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:29.943647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902b9e0-4bb7-4a42-9caa-22d905d513a2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:29.948155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:29.949319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:29.949598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:29.949870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] PATH_INFO: `/v3/projects/05869adb61214f878dfb2cd13c841b78` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:29.952217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] RBAC: Authorizing `identity:get_project(project_id=05869adb61214f878dfb2cd13c841b78)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:30.004255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 01 04:03:30.004597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5454292-c66e-4fab-a771-d85b1abeadea admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:30.009379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Sat Oct 1 04:03:29 2022] GET /identity/v3/projects/05869adb61214f878dfb2cd13c841b78 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:32.108583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dfcd8-3c6e-43c7-b49b-025bd18a7d7d None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:32.109076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dfcd8-3c6e-43c7-b49b-025bd18a7d7d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:32.109076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dfcd8-3c6e-43c7-b49b-025bd18a7d7d None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:32.113152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:32.118444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:32.118840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:32.118993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:32.138554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:32.140097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:32.147975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 01 04:03:32.411356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dfcd8-3c6e-43c7-b49b-025bd18a7d7d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:32.423813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dfcd8-3c6e-43c7-b49b-025bd18a7d7d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:32.428142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693303cd-3a60-4492-a22f-75ea736ccba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:32.428741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693303cd-3a60-4492-a22f-75ea736ccba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:32.429023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693303cd-3a60-4492-a22f-75ea736ccba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:32.429297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693303cd-3a60-4492-a22f-75ea736ccba2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:32.437438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693303cd-3a60-4492-a22f-75ea736ccba2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:32.439208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693303cd-3a60-4492-a22f-75ea736ccba2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:32.447775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Sat Oct 1 04:03:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:03:32.452885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:32.461932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ec2e1-f7e0-4730-bee3-fa43ad089ceb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:32.466172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48c042-30ed-4691-822f-62a9c2f1ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:32.466792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48c042-30ed-4691-822f-62a9c2f1ac56 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:32.467070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48c042-30ed-4691-822f-62a9c2f1ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:32.467337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48c042-30ed-4691-822f-62a9c2f1ac56 admin admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:32.468657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48c042-30ed-4691-822f-62a9c2f1ac56 admin admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:32.470466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48c042-30ed-4691-822f-62a9c2f1ac56 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:32.471976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Sat Oct 1 04:03:32 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:34.672273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc9aa-0e02-4924-8e02-45dd250a50c2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:34.672819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc9aa-0e02-4924-8e02-45dd250a50c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:34.672819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc9aa-0e02-4924-8e02-45dd250a50c2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:34.674143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:34.679425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:34.679801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:34.680007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:34.697770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:34.698954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:34.708377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ee13-5926-440b-addb-41f9dba9f510 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:34.708661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ee13-5926-440b-addb-41f9dba9f510 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:34.708935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ee13-5926-440b-addb-41f9dba9f510 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:34.710245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:03:34.715292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:34.715576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:34.715852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:34.757878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG passlib.handlers.bcrypt [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81721) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 01 04:03:34.758259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG passlib.handlers.bcrypt [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81721) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 01 04:03:34.782204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:34.808242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:34.809911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:34.912947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:03:35.055533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.082195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.163413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4cf08-dfd2-4ea7-b5b2-aabd92e7c2e1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.180969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.197298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.197944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.198223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.198497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.210317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:35.219680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:35.220780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:03:35.221613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:35.226622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.283020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735f42a-7961-4938-802d-2ea8dee25049 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.285275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.311015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.320394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.321259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.321537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.321804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.329227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3571-97ca-4fb1-844d-22ea737f3fe8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.363606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.364244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.364519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.364789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.365452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:35.365752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.367141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.378985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:35.384687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.392713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.394243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.485062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b009ff-ec18-4a1c-bc6e-6e8c5e7f0f47 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.490796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 04:03:35.496339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.499306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.519835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.520507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.520784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.521055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.522432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.523868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.525448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:35.531323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.546841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.593948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec5a26-7589-4f1f-8250-71ddf2121b86 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.627571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.628696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.628971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.629240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.631721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c05a0-8bad-4b5f-adec-6c168b2bbc71 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.647577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.649076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.665988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.666622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.666899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.667172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:03:35.667541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:35.668572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:03:35.670133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:03:35.670133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:03:35.670133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:35.670133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:03:35.671134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.672632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.674175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:35.675714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.679881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:35.738246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.760104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:35.780183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f057c-f445-4a2f-b13b-149b5e3581ed None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.782628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fd5e9-000a-42ef-aad5-f38e00c83708 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:35.813040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.813654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.813932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.814200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.814941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.domain.id=default, user.id=84677dff283a4e27afa450cf4325d25f) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:35.815247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.816698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9525-c964-4910-b03b-f4ac406b8f95 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.819411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:35.820051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:35.820332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:35.820606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:35.821249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:35.821552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:35.822921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dc792-aa54-415e-a083-3b4b8c611e76 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:35.823328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/role_assignments?user.id=84677dff283a4e27afa450cf4325d25f&scope.domain.id=default&role.id=8fdee6d92c844466842df5998d45def4 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:35.842398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:38.265937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd4d50-8a6f-4c15-8378-96e778b75e1f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:38.266954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd4d50-8a6f-4c15-8378-96e778b75e1f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:38.267447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd4d50-8a6f-4c15-8378-96e778b75e1f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:38.269287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:38.272631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f36b6-8f69-482f-986a-de62b3c250d6 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:38.273788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f36b6-8f69-482f-986a-de62b3c250d6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:38.274281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f36b6-8f69-482f-986a-de62b3c250d6 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:38.277030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:38.277453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 11/23] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:38.277968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:38.279132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:38.283177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd54d9-930c-4f3c-b64f-1f0b46b6c08c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:38.283689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd54d9-930c-4f3c-b64f-1f0b46b6c08c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:38.284183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd54d9-930c-4f3c-b64f-1f0b46b6c08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:38.323957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:38.325267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0ddd54d9-930c-4f3c-b64f-1f0b46b6c08c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:38.327071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0ddd54d9-930c-4f3c-b64f-1f0b46b6c08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:38.328459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:38.482395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 13/24] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:38.495068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 12/25] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:38.936937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:38.959987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eb66-c74d-4b88-8bed-2a3f2a5ec1ef None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:38.960289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eb66-c74d-4b88-8bed-2a3f2a5ec1ef None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:38.960549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eb66-c74d-4b88-8bed-2a3f2a5ec1ef None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:38.961956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 13/26] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:38.967761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:38.968070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:38.968347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:38.994864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:38.996848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:39.068304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:39.098261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:39.111811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2f35-b4e4-4b03-9d6e-99809b5a7f4e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:39.149629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:39.150788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.220664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:39.221331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.221612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.221890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.238391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:39.240110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:39.266378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6535c-b4b8-42b6-9730-82a976827355 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0ea047e2-f719-478d-86cc-7a6976020c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:03:39.267213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:39.268396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:03:39.269195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:03:39.269195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:03:39.269195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:03:39.272278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:39.273783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ca11-38ea-4f3d-b723-c107214b769d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.274266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ca11-38ea-4f3d-b723-c107214b769d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.274736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ca11-38ea-4f3d-b723-c107214b769d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.276519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 15/29] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:39.280915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ca11-38ea-4f3d-b723-c107214b769d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.328519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff7672-88e9-46d0-bd5d-f5476fb74489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:39.329221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7672-88e9-46d0-bd5d-f5476fb74489 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.329450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7672-88e9-46d0-bd5d-f5476fb74489 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.329721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7672-88e9-46d0-bd5d-f5476fb74489 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.371043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff7672-88e9-46d0-bd5d-f5476fb74489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c8ff7672-88e9-46d0-bd5d-f5476fb74489 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:39.380721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:39.381593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:39.382397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 15/30] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:39.385496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.385789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.386063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.421410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:39.422610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:39.430189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ca11-38ea-4f3d-b723-c107214b769d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:39.455901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:39.494509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:39.500315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 16/31] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:39.500957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.514924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:39.515550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.515828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.516128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.516787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:39.517143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:39.518549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:39.547985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 16/32] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:39.552731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.617416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39089812-53de-47ad-87f6-67f29f9410bd None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:39.655693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:39.656261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.656539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.656812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.657480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:39.657777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:39.659271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:39.672140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:39.673006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.702476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:39.758774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709683e2-b902-45b6-aa23-1ed4dbd0d759 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:39.789522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f8a-0d7f-456a-a189-2b0e85be8e7d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:39.796395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:39.797049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.797329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.797602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.798283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:39.799664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:39.832828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f2de-229e-49eb-8b8a-ad8c11ac9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:39.833485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f2de-229e-49eb-8b8a-ad8c11ac9edc None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.833769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f2de-229e-49eb-8b8a-ad8c11ac9edc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.834041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f2de-229e-49eb-8b8a-ad8c11ac9edc None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.834932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f2de-229e-49eb-8b8a-ad8c11ac9edc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:39.836413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f2de-229e-49eb-8b8a-ad8c11ac9edc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:39.932046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 17/34] 10.222.0.27 () {60 vars in 1131 bytes} [Sat Oct 1 04:03:39 2022] POST /identity/v3/roles => generated 219 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:03:39.932046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.975452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 18/35] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:03:39 2022] POST /identity/v3/projects => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:03:39.977046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c770a5a-1755-4280-9dcc-fae6c1a5e1e2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:39.977339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c770a5a-1755-4280-9dcc-fae6c1a5e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:39.977658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c770a5a-1755-4280-9dcc-fae6c1a5e1e2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:39.979042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:39.980056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c770a5a-1755-4280-9dcc-fae6c1a5e1e2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:39.999886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:40.072956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2360d-1af8-41f2-917c-ae6326d428c4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:40.115020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc72b6-e357-490c-9533-ab8736ae35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:40.115689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc72b6-e357-490c-9533-ab8736ae35c4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.116002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc72b6-e357-490c-9533-ab8736ae35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.116285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc72b6-e357-490c-9533-ab8736ae35c4 None admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.117603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc72b6-e357-490c-9533-ab8736ae35c4 None admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:40.119344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc72b6-e357-490c-9533-ab8736ae35c4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:40.121420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 18/37] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:39 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:40.122802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.123165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.123434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.144377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:40.146099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:40.164514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:40.194340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c770a5a-1755-4280-9dcc-fae6c1a5e1e2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:40.235131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 19/38] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:40.236092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:40.239314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10723b11-dcf7-4bb7-b056-2192b4b0a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:40.240205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10723b11-dcf7-4bb7-b056-2192b4b0a51e None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.240686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10723b11-dcf7-4bb7-b056-2192b4b0a51e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.241141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10723b11-dcf7-4bb7-b056-2192b4b0a51e None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.241993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10723b11-dcf7-4bb7-b056-2192b4b0a51e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:40.243690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10723b11-dcf7-4bb7-b056-2192b4b0a51e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:40.262360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 20/39] 10.222.0.27 () {60 vars in 1131 bytes} [Sat Oct 1 04:03:39 2022] POST /identity/v3/roles => generated 225 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:03:40.264701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6247-3f66-40c1-a055-a7a6218ac1e1 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.265172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6247-3f66-40c1-a055-a7a6218ac1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.265627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6247-3f66-40c1-a055-a7a6218ac1e1 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.267043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 21/40] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:40.280251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.280985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.281257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.303394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:40.304673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:40.307087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:40.380199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c472ed-8c41-4ee6-baa6-f7aa055e41d9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:40.405044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 22/41] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:03:40.425612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:40.426273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.426554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.426827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.428026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:40.429513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:40.431481 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 20/42] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:40.438099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:40.513016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:40.546385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe302b-edf0-40fc-bf5d-f4ff76c7b16b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:40.575675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:40.581586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:40.582261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.582540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.582815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] PATH_INFO: `/v3/domains/default/users/84677dff283a4e27afa450cf4325d25f/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.585007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=84677dff283a4e27afa450cf4325d25f, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:40.586451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:40.604086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1361 bytes} [Sat Oct 1 04:03:40 2022] PUT /identity/v3/domains/default/users/84677dff283a4e27afa450cf4325d25f/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:03:40.698135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:40.802496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcfaf4-9205-4d32-bc4c-3bfb64704d84 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:40.815177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b25194-783e-483e-bd3d-855146a14f24 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:40.817430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:40.841060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:40.841688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.841975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.842339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.843025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:40.844442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:40.849363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:40.857329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2656a1-caec-40cf-b8e1-f46a8d8b9055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:40.858211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2656a1-caec-40cf-b8e1-f46a8d8b9055 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:40.858544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2656a1-caec-40cf-b8e1-f46a8d8b9055 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:40.858908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2656a1-caec-40cf-b8e1-f46a8d8b9055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:40.860594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2656a1-caec-40cf-b8e1-f46a8d8b9055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:40.862554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Sat Oct 1 04:03:40 2022] POST /identity/v3/roles => generated 223 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:03:40.862662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2656a1-caec-40cf-b8e1-f46a8d8b9055 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:40.864440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:40.870334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:40.985800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba276a5-fedf-4c14-b5d2-aac47f1cfe72 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:41.024090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1112a07-e42a-44b9-b96a-415c04aea522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:41.024727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112a07-e42a-44b9-b96a-415c04aea522 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:41.025012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112a07-e42a-44b9-b96a-415c04aea522 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:41.025299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112a07-e42a-44b9-b96a-415c04aea522 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:41.025969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1112a07-e42a-44b9-b96a-415c04aea522 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:41.027454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1112a07-e42a-44b9-b96a-415c04aea522 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:41.059161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:03:40 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:03:42.756080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced493d-4b24-42b1-876b-52c715d82ad2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:42.756590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced493d-4b24-42b1-876b-52c715d82ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:42.756699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced493d-4b24-42b1-876b-52c715d82ad2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:42.758116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:42.763242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a4b96-7efd-47e0-a441-9277d0474783 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:42.763618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a4b96-7efd-47e0-a441-9277d0474783 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:42.763914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a4b96-7efd-47e0-a441-9277d0474783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:42.782728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-548a4b96-7efd-47e0-a441-9277d0474783 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:42.783913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-548a4b96-7efd-47e0-a441-9277d0474783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:42.801480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:42.853666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:43.118987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced493d-4b24-42b1-876b-52c715d82ad2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.206371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4dc0-3655-45b5-88f5-7ef6e1285520 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.206657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4dc0-3655-45b5-88f5-7ef6e1285520 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.206940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4dc0-3655-45b5-88f5-7ef6e1285520 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.208369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 24/49] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:03:43.214238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.214527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.214803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.234201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:43.235437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:43.304388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 25/50] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:03:43.321867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced493d-4b24-42b1-876b-52c715d82ad2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.353741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.354362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.354641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.354911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.365106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:43.369966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:43.370951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:43.371858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 26/51] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:43.376827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.457581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:43.473806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199e52d-1601-4d4d-8aa3-7e821ac7358a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.509519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.510128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.510408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.510681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.511343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:43.511645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:43.513635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:43.521485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 26/52] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:43.528017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.572703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.584283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:43.626779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99d10-ded3-49b7-802e-63814a27ba38 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.660198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.660832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.661115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.661401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.662525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:43.664012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:43.665761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:43 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:43.671133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb67f-0ec3-4213-a0c6-db9ea2652dee None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.671419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.704190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.704816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.705099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.705376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.706489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:43.707915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:43.709486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 27/54] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:43.714854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.729887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:43.770495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd897f0-1a8f-43d9-819d-cca4b2d0452f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.795885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:43.805972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.806704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.806987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.807262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.808411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:43.809894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:43.811460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:43.817052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:43.817367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9aa0-95d0-498d-b4c0-3851da5dcdff None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.852920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94038b-1847-419a-abb9-87912a01ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.853536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94038b-1847-419a-abb9-87912a01ab8d None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.853835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94038b-1847-419a-abb9-87912a01ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.854088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94038b-1847-419a-abb9-87912a01ab8d None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.854736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94038b-1847-419a-abb9-87912a01ab8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:43.856244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94038b-1847-419a-abb9-87912a01ab8d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:43.881906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 28/56] 10.222.0.27 () {60 vars in 1140 bytes} [Sat Oct 1 04:03:43 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:03:43.920096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88851e8-ad7d-4a6b-b069-3e5046b6ad3e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:43.955966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:43.956600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:43.956883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:43.957159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:43.957908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.domain.id=default, user.id=84677dff283a4e27afa450cf4325d25f) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:43.958219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:43.959698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca353f40-6fb7-4bbd-8400-24f896d5a274 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:43.968951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1322 bytes} [Sat Oct 1 04:03:43 2022] GET /identity/v3/role_assignments?user.id=84677dff283a4e27afa450cf4325d25f&scope.domain.id=default&role.id=8fdee6d92c844466842df5998d45def4 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:03:46.025235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e517-da98-4fe0-ac65-e164421ae9a0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:46.025733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e517-da98-4fe0-ac65-e164421ae9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:46.025817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e517-da98-4fe0-ac65-e164421ae9a0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:46.027128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 29/58] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:46.033057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:46.033457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:46.033616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:46.051171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:46.052393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:46.104795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:46.118470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:46.386997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e517-da98-4fe0-ac65-e164421ae9a0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:46.452780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:46.488522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e517-da98-4fe0-ac65-e164421ae9a0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:46.521397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524c95-ea0a-4101-9738-418f4efcd04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:46.522293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524c95-ea0a-4101-9738-418f4efcd04e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:46.522574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524c95-ea0a-4101-9738-418f4efcd04e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:46.522848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524c95-ea0a-4101-9738-418f4efcd04e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:46.523976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6524c95-ea0a-4101-9738-418f4efcd04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:46.525414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6524c95-ea0a-4101-9738-418f4efcd04e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:46.526955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 30/60] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:46.532964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:46.627295 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953cb44-811c-42cf-90bb-ce7f379164ab None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:46.659878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711febad-0464-44b5-901c-157a7e4c2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:46.660454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711febad-0464-44b5-901c-157a7e4c2e41 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:46.660740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711febad-0464-44b5-901c-157a7e4c2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:46.661021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711febad-0464-44b5-901c-157a7e4c2e41 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:46.661664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711febad-0464-44b5-901c-157a7e4c2e41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:46.663092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711febad-0464-44b5-901c-157a7e4c2e41 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:46.689671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 31/61] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:03:46 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:03:49.858574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb338-1593-44ad-8437-6f9fd85ec386 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:49.859553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb338-1593-44ad-8437-6f9fd85ec386 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:49.860179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb338-1593-44ad-8437-6f9fd85ec386 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:49.861751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 31/62] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:49.867163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a68d57-9801-4c25-8f1f-33206d643e4f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:49.867971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a68d57-9801-4c25-8f1f-33206d643e4f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:49.868451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a68d57-9801-4c25-8f1f-33206d643e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:49.888095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-91a68d57-9801-4c25-8f1f-33206d643e4f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:49.889722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-91a68d57-9801-4c25-8f1f-33206d643e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:49.937587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:49.972380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 32/63] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:50.023113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00732-f5e2-4477-8c09-d95e59e61622 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.023408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00732-f5e2-4477-8c09-d95e59e61622 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.023679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d00732-f5e2-4477-8c09-d95e59e61622 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.025055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 32/64] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:50.042777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3665dc-fe84-4ba3-843f-5450cda953d8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.043142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3665dc-fe84-4ba3-843f-5450cda953d8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.043408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3665dc-fe84-4ba3-843f-5450cda953d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.063208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4b3665dc-fe84-4ba3-843f-5450cda953d8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:50.068540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4b3665dc-fe84-4ba3-843f-5450cda953d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:50.166559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:50.202792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f1cd9-80b2-41b1-9671-3fa1889f2d6f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.203081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f1cd9-80b2-41b1-9671-3fa1889f2d6f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.203550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f1cd9-80b2-41b1-9671-3fa1889f2d6f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.205113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 33/66] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:50.210346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.210638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.210920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.236956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:50.238185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:50.329248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 34/67] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:50.427476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f1cd9-80b2-41b1-9671-3fa1889f2d6f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:50.548619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f1cd9-80b2-41b1-9671-3fa1889f2d6f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:50.550791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:50.602575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dff32-56ce-497b-8a2a-8e47e440d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:50.603225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dff32-56ce-497b-8a2a-8e47e440d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.603514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dff32-56ce-497b-8a2a-8e47e440d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.603795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dff32-56ce-497b-8a2a-8e47e440d3e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.612314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:50.617524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dff32-56ce-497b-8a2a-8e47e440d3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-116dff32-56ce-497b-8a2a-8e47e440d3e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:50.623479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:50.624652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:50.625606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:03:50.632529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:50.632719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 34/68] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:50.632719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04fd1-44d5-446b-8d7a-6f28f4c97aab None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.632719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04fd1-44d5-446b-8d7a-6f28f4c97aab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.632719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04fd1-44d5-446b-8d7a-6f28f4c97aab None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.633947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 35/69] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:50.635486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04fd1-44d5-446b-8d7a-6f28f4c97aab None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:50.716745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c79ef9-2268-4715-9bbf-bd285ecf4db4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:50.746765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04fd1-44d5-446b-8d7a-6f28f4c97aab None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:50.753567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf7fd4-523f-4d62-a5f8-a33517c885a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:50.754208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7fd4-523f-4d62-a5f8-a33517c885a0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.754482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7fd4-523f-4d62-a5f8-a33517c885a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.754749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7fd4-523f-4d62-a5f8-a33517c885a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.765202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf7fd4-523f-4d62-a5f8-a33517c885a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fbcf7fd4-523f-4d62-a5f8-a33517c885a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:50.770002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:50.770935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:50.772217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 35/70] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:03:50.773337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5f8d9-641c-43ad-beab-241b5f8f33f8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.773337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5f8d9-641c-43ad-beab-241b5f8f33f8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.773488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5f8d9-641c-43ad-beab-241b5f8f33f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.783414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:50.784067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.784356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.784636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.785305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:50.785614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:50.787008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:50.790756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b7b5f8d9-641c-43ad-beab-241b5f8f33f8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:50.791950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b7b5f8d9-641c-43ad-beab-241b5f8f33f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:50.795626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:50.797536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:50.854136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:50.859028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 36/72] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:50.860505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b141a2-e13d-4eee-94a7-717d0a850b64 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.860795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b141a2-e13d-4eee-94a7-717d0a850b64 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.861074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b141a2-e13d-4eee-94a7-717d0a850b64 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.862344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 37/73] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:50.863045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b141a2-e13d-4eee-94a7-717d0a850b64 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:50.888273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:50.910160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ae68-3b93-4485-96c8-08e53762bb82 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:50.942856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:50.943490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:50.943884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:50.944182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:50.954463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:50.959713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:50.960584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:03:50.961357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 37/74] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:50.966721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:50.973400 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b141a2-e13d-4eee-94a7-717d0a850b64 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.012775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.013531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.013813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.014084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.014906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:51.015213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.017235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e4744-6251-4076-9a61-3f1b70203456 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.032254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 38/75] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:03:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.032254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.032254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.032254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.050532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:51.051773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:51.070504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0357ec-25fd-47bf-ac22-1e6f82b13fb5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.087598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.108801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.109446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.109722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.109999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.111116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.112730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.114499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 38/76] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:50 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.115381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.124254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 39/77] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:51.125721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.146962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.220765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f6fce-9a06-410b-86f5-c898b86e1a28 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.238291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cabf65-d70f-45ce-890f-48e325661c22 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.254645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.255466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.255891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.256340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.257001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:51.257450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.258983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.272088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 39/78] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.272933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.275832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.277972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.278177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.278450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.295313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.296809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.298431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 40/79] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.299208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.326898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.379576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.388107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064e6d5-9e6a-48d3-8fad-f2abb232e52e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.406129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad7d0-3499-4da4-b7b2-8b3732fbffe0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.422004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.422618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.422904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.423186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.439733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.440392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.440675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.440954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.450932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:51.456154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:51.457040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:51.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:51.458437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.491331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.492799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.537007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.559664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76c0f-2e66-46cc-9f07-928e5ca846de None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.591217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 40/81] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:03:51.592084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.593126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.593766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.594058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.594339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.595508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.597077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.598781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 42/82] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.599457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.602063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.693030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab45e17-2430-4364-ae6c-966580303393 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.697102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab0009-0a7d-4994-bfff-ffe273cbcf87 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.726612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.727221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.727505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.727783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.730298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508405-0960-41e3-9977-38951be67855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.731538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508405-0960-41e3-9977-38951be67855 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.731816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508405-0960-41e3-9977-38951be67855 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.732121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508405-0960-41e3-9977-38951be67855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.733217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d508405-0960-41e3-9977-38951be67855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.734656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d508405-0960-41e3-9977-38951be67855 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.736245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 43/83] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.737008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508405-0960-41e3-9977-38951be67855 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.743534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.795340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.796854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.806921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.838645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508405-0960-41e3-9977-38951be67855 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.872666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:51.873283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:51.873567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:51.873844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:51.874513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:51.874827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:51.876233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:51.883978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 44/84] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:51.884871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.898534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 41/85] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:03:51.899382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:51.943995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:51.986795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e7f89-12a9-4811-b2d6-8c7155853b06 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:51.996879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed219aa-7618-443a-838b-99a888bd3e00 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.015193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.020890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.021774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.022053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.022383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.023505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.024964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.026569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 45/86] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:52.028151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.032061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.032767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.033056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.033340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.099000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.100485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.124846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d3f8-f21b-438d-b891-28bdd9af0b8e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.147553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.157665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.158270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.158548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.158819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.159461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.160925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.184158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 46/87] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:03:52 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:03:52.184981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.207294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 42/88] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:03:52.208552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.252392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.303803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803aa5d-74e4-4e2e-92c2-32550c5134d4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.320660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe71e-33d9-435e-9cff-e88c438ca31c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.342758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.343700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.344240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.344656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.345995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.347843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.349616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 47/89] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:52.350397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.364135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.365169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.365546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.365827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.366961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.368474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.370595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 43/90] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:52.370887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.392456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.473092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2fb1-ee94-406c-a9b2-dd6e5d4d3a3a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.496546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b84972-9f98-4417-9d75-4c9aa261fd97 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.504447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.517772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.518705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.518997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.519279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.520054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=84677dff283a4e27afa450cf4325d25f) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:52.520370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.522082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.528806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 48/91] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/role_assignments?user.id=84677dff283a4e27afa450cf4325d25f&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:52.529694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.539177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.540145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.540434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.540712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.541975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.543570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.550325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 44/92] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:52.550325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.691119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f3538-96aa-4dbf-b87f-d90f3bda7e91 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.699477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.726323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3d92-6996-4d43-bc6f-6a74b5c8122a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:52.753277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.753896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.754172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.754444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.791411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:52.791966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:52.792249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:52.792520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:52.793794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:52.794097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.795541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.803881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 45/93] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/role_assignments?user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=dd4261a805134646858c0ad93ba486fd => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:52.804981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:52.864216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:52.902191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:52.903842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:52.993244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594335d7-e179-4add-a4ca-f94a6a7a2cfe None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:53.064812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:53.065386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:53.066085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:53.066366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:53.067428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] RBAC: Adding query filter params (role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:53.067752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:53.069286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:53.086540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 46/94] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/role_assignments?user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:53.133326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 49/95] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:03:53.139802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:53.155036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:53.287211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8eeee-f3cd-411f-bcee-701eda0860ef None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:53.333338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313ea4-0741-472e-8879-ab38a30e20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:53.333917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313ea4-0741-472e-8879-ab38a30e20e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:53.334201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313ea4-0741-472e-8879-ab38a30e20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:53.334480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313ea4-0741-472e-8879-ab38a30e20e4 None admin] PATH_INFO: `/v3/projects/aad3e0416dcd4d8499be67ee283be84c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:53.341031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a313ea4-0741-472e-8879-ab38a30e20e4 None admin] RBAC: Authorizing `identity:get_project(project_id=aad3e0416dcd4d8499be67ee283be84c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:53.342532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a313ea4-0741-472e-8879-ab38a30e20e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:53.344358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 47/96] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:53 2022] GET /identity/v3/projects/aad3e0416dcd4d8499be67ee283be84c => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:53.351555 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:53.517569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:53.534743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d823a81-6117-478a-823f-e84fa7f8e3f1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:53.580608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:53.581628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:53.582109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:53.582581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:53.583571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=aad3e0416dcd4d8499be67ee283be84c, user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:53.584141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:53.585842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f33bb-7b78-4a51-87f9-d755b2014980 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:53.592786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 50/97] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:03:53 2022] GET /identity/v3/role_assignments?user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9&scope.project.id=aad3e0416dcd4d8499be67ee283be84c&role.id=dd4261a805134646858c0ad93ba486fd => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:55.373509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b158-42a8-4f95-ad1c-10a484a036fc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.374091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b158-42a8-4f95-ad1c-10a484a036fc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.374091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6b158-42a8-4f95-ad1c-10a484a036fc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.375407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 48/98] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:55.381463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018cc13-56d2-4eb2-b591-aedf99decf2e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.382410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018cc13-56d2-4eb2-b591-aedf99decf2e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.382935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018cc13-56d2-4eb2-b591-aedf99decf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.403626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d018cc13-56d2-4eb2-b591-aedf99decf2e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:55.404886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d018cc13-56d2-4eb2-b591-aedf99decf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:55.485270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952cdbc-826d-4fa6-a8b9-60fb68a5ce62 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.485580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952cdbc-826d-4fa6-a8b9-60fb68a5ce62 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.485873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952cdbc-826d-4fa6-a8b9-60fb68a5ce62 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.488825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 49/99] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:55.489013 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 51/100] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:55.493405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362cf0-b97e-47d4-812f-6d75fd87acac None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.493780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362cf0-b97e-47d4-812f-6d75fd87acac None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.494085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362cf0-b97e-47d4-812f-6d75fd87acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.524932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9d362cf0-b97e-47d4-812f-6d75fd87acac None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:55.526490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9d362cf0-b97e-47d4-812f-6d75fd87acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:55.633318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 50/101] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:03:55.734062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524aa9-1abd-4908-aa60-2e1d4a19fa3e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.734403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524aa9-1abd-4908-aa60-2e1d4a19fa3e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.734620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524aa9-1abd-4908-aa60-2e1d4a19fa3e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.736268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 52/102] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:55.741871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200de17-6f4a-4ac2-9fbd-329e9ab22f6d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.742489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200de17-6f4a-4ac2-9fbd-329e9ab22f6d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.742987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200de17-6f4a-4ac2-9fbd-329e9ab22f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.773090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e200de17-6f4a-4ac2-9fbd-329e9ab22f6d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:55.774677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e200de17-6f4a-4ac2-9fbd-329e9ab22f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:55.777715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:55.878388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 51/103] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:55.881952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb03b9-af6c-4d71-aec0-e00b982fa2e5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.882514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb03b9-af6c-4d71-aec0-e00b982fa2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.882991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb03b9-af6c-4d71-aec0-e00b982fa2e5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.884610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 53/104] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:55.890227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:55.890758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:55.891302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:55.910719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:55.912300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:55.982580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb03b9-af6c-4d71-aec0-e00b982fa2e5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:55.997296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 52/105] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:56.053942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.173742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:56.182361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:56.223143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3634c-0a9e-46ee-9dcf-81eeed4f4efa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.252610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb03b9-af6c-4d71-aec0-e00b982fa2e5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.259036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673aa63-7228-4f51-b6fa-68036fbd9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.259961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673aa63-7228-4f51-b6fa-68036fbd9459 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.260482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673aa63-7228-4f51-b6fa-68036fbd9459 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.261015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673aa63-7228-4f51-b6fa-68036fbd9459 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.262343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673aa63-7228-4f51-b6fa-68036fbd9459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:56.264010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673aa63-7228-4f51-b6fa-68036fbd9459 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:56.266279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 53/106] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:56.267622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d982-3a2b-4482-9eb4-3e82ebf06b52 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.268145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d982-3a2b-4482-9eb4-3e82ebf06b52 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.268619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d982-3a2b-4482-9eb4-3e82ebf06b52 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.270380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 54/107] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:56.271536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2d982-3a2b-4482-9eb4-3e82ebf06b52 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.306668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a3f8f-b545-481a-b767-fe297860bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.308401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a3f8f-b545-481a-b767-fe297860bd10 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.309153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a3f8f-b545-481a-b767-fe297860bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.309629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a3f8f-b545-481a-b767-fe297860bd10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.320701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a3f8f-b545-481a-b767-fe297860bd10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b16a3f8f-b545-481a-b767-fe297860bd10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:56.327062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:56.327909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:03:56.328771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:56.331179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 54/108] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:03:56.332550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.333052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.333520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.357526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:56.359816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:56.384320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2d982-3a2b-4482-9eb4-3e82ebf06b52 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.423950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.424512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.424845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.425122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.425824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:56.427270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:56.432597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:56.440497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 55/109] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:56.440497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.467959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 55/110] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:03:56 2022] POST /identity/v3/projects => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:03:56.467959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.582520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:56.636455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde8111-c196-4bad-88d3-8f93ce9bc595 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.654758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d480e-30fa-4303-a1b4-f4ebad37f8b3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.704048 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.705299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.705784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.706256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.707156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:56.707515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:56.710030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:56.719820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 56/111] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:56.720700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.732753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.733954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.734238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.734827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.747659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:56.752730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:56.753584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:56.754332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 56/112] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:56.754958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.788115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:56.853360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0920b8-71a1-43ba-9cef-86200384f3ec None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.889455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.890098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.890427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.890710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.897465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5039b0-c244-416a-a889-c18556b29904 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:56.901745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:56.908715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:56.909751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 57/113] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:56.910705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:56.944953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:56.946255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:56.948107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:56.948847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:56.949333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:56.961483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:56.968455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:56.969493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:03:56.970459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:03:56.972605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 57/114] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:56.978091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.035875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714062f9-36bf-4421-b47c-470bfae7edc1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.046787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.071699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.072567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.072673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.072926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] PATH_INFO: `/v3/users/2cbe189ccd064fd7966f4119ef51636e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.090773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] RBAC: Authorizing `identity:get_user(user_id=2cbe189ccd064fd7966f4119ef51636e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.093471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.095975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 58/115] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/users/2cbe189ccd064fd7966f4119ef51636e => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.101147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.116749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0482e7a-9256-4bf1-928d-d96e102b841a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.154267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.154893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.155175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.155548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.156144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:57.156443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.157823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.166904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 58/116] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.168077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.212207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e0ba-a257-4b73-a604-ecaca6324bbf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.227591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.247839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.248487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.248773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.249052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.249781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:57.250090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.251500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.259698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 59/117] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.260549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.281693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44281ce0-267c-4cfb-9450-701d22d9d759 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.294461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.319360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.320281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.320745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.321019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.321686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:57.321992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.323358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707841f-169f-4f78-b3ae-1033d72393f3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.332107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 59/118] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.337659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab254-7e2f-4f92-9ff1-1e768d6137c4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.338170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab254-7e2f-4f92-9ff1-1e768d6137c4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.338654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab254-7e2f-4f92-9ff1-1e768d6137c4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.344080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 60/119] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:03:57.345536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dab254-7e2f-4f92-9ff1-1e768d6137c4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.371946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dd00a-1458-4817-a579-f29f080f6355 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.408986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.409628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.409878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.410153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.456997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dab254-7e2f-4f92-9ff1-1e768d6137c4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.475241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.479315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.481581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.499769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.500814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.501083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.501359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.502583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.504695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.506654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 61/120] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.507499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.513310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.592560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 60/121] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:03:57.594083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.617107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14164-27ce-4e8b-8c81-f2a13a29f338 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.652402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc986f9-32c3-47af-8794-321679a47c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.653039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc986f9-32c3-47af-8794-321679a47c74 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.653321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc986f9-32c3-47af-8794-321679a47c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.653813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc986f9-32c3-47af-8794-321679a47c74 None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.654720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc986f9-32c3-47af-8794-321679a47c74 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.656183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc986f9-32c3-47af-8794-321679a47c74 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.657922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 62/122] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.658853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.659138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.659415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.676903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:57.677761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:57.702555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4ee6f-e3da-42d8-a445-c4495d6849b8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.727616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.732906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:57.739584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.740368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.740655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.740993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.742160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.743617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.750070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 61/123] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.750070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.754841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 63/124] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:03:57.755921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.876833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0457c-bdcd-4a1f-b6e8-2915e3f0f46b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.896005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7681d-f341-4d58-8ce1-174196c16bef None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:57.913064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.913707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.913983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.914254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.915500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.918163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.920392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 62/125] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.921160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:57.942330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:57.942973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:57.943252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:57.943524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:57.944659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:57.946092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:57.947700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 64/126] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:57.948492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.000930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.003107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.043350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a9d4-f8fe-4040-ac89-d45d125e565f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.053533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674a494-ba15-4fb9-966c-c0b5e71d75cd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.078668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.079371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.079660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.079956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.081158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.082592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.088773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 63/127] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:58.088773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.092563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.093384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.093853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.094302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.095478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.096924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.098524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 65/128] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:57 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:58.103737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.188623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0582-2539-4e66-96e6-055f50862644 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.207354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd334401-ce72-4e56-b1cc-b6fe584f1e23 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.225234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.229954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.230627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.230908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.231184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163/users/84677dff283a4e27afa450cf4325d25f/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.233203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] RBAC: Authorizing `identity:create_grant(project_id=36d03b6452324c61890a85691e4e0163, user_id=84677dff283a4e27afa450cf4325d25f, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.234645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.237064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.243824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.244456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.244788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.245062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.246845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] RBAC: Adding query filter params (role.id=ba2a55ff43e847b3b060c16062a75c1e, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=2cbe189ccd064fd7966f4119ef51636e) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:58.247164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.248859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.260365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 64/129] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:03:58 2022] PUT /identity/v3/projects/36d03b6452324c61890a85691e4e0163/users/84677dff283a4e27afa450cf4325d25f/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:03:58.260365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.260621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 66/130] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:03:58 2022] GET /identity/v3/role_assignments?user.id=2cbe189ccd064fd7966f4119ef51636e&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=ba2a55ff43e847b3b060c16062a75c1e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:58.264566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.468480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68ba3-d3aa-45ed-bff6-e24c2396d067 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.501611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4ba1-c791-49e2-9ef3-ca7c29dd27a0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.514333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.514911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.515194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.515466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.528829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:03:58.539312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.540352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.540833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.541303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163/users/6e0dc09ddedf4d0e950ee4460e0bc2c9/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.543514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] RBAC: Authorizing `identity:create_grant(project_id=36d03b6452324c61890a85691e4e0163, user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:03:58.543820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:03:58.544762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:03:58.545528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 65/131] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:03:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:03:58.546157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.548373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.565322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 67/132] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:03:58 2022] PUT /identity/v3/projects/36d03b6452324c61890a85691e4e0163/users/6e0dc09ddedf4d0e950ee4460e0bc2c9/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:03:58.566574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.618605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.659163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.687734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a2a79-cc9f-4bcf-937b-f7ac5887025d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.725947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.726921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.727418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.727958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.728917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:03:58.729427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.731685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.739683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287169-8c82-41c4-9b01-f8c77dc51520 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.742023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 68/133] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:03:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:58.749058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.815645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.816297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.816581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.816852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163/users/6e0dc09ddedf4d0e950ee4460e0bc2c9/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.821857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] RBAC: Authorizing `identity:create_grant(project_id=36d03b6452324c61890a85691e4e0163, user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9, role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.823358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.857793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 66/134] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:03:58 2022] PUT /identity/v3/projects/36d03b6452324c61890a85691e4e0163/users/6e0dc09ddedf4d0e950ee4460e0bc2c9/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:03:58.879203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b870d7a-9f8d-4576-b79f-839f33fa9fc9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:58.884535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:58.923837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cbca2-d822-4fe1-906b-e414b3178a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:58.924748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbca2-d822-4fe1-906b-e414b3178a81 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.925228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbca2-d822-4fe1-906b-e414b3178a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.925673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbca2-d822-4fe1-906b-e414b3178a81 None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.927068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cbca2-d822-4fe1-906b-e414b3178a81 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:58.929013 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cbca2-d822-4fe1-906b-e414b3178a81 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:58.930852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 69/135] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:03:58 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:58.937678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:58.984905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea631c3-8c42-4c50-9ba2-309478f913e9 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.985449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea631c3-8c42-4c50-9ba2-309478f913e9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.985868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea631c3-8c42-4c50-9ba2-309478f913e9 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:58.987361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 70/136] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:03:58.996755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:58.997357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:58.997801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:59.026315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:03:59.030102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:03:59.121178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84611978-e9c5-41e6-986d-3bda31bf539b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:59.136502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:59.162026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:59.162682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:59.163029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:59.163313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] PATH_INFO: `/v3/projects/aad3e0416dcd4d8499be67ee283be84c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:59.165212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] RBAC: Authorizing `identity:get_project(project_id=aad3e0416dcd4d8499be67ee283be84c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:59.167262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:59.169007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 67/137] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:03:58 2022] GET /identity/v3/projects/aad3e0416dcd4d8499be67ee283be84c => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:59.176438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:59.177359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 71/138] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:03:59.306225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ef01-1137-4a20-9762-d0fee8d5e12c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:59.350846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:59.351533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:59.351821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:59.352139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] PATH_INFO: `/v3/projects/aad3e0416dcd4d8499be67ee283be84c/users/6e0dc09ddedf4d0e950ee4460e0bc2c9/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:59.354149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] RBAC: Authorizing `identity:create_grant(project_id=aad3e0416dcd4d8499be67ee283be84c, user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:59.355688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:59.378604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 68/139] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:03:59 2022] PUT /identity/v3/projects/aad3e0416dcd4d8499be67ee283be84c/users/6e0dc09ddedf4d0e950ee4460e0bc2c9/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:03:59.542830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:59.697348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6162ca9-5325-4bde-a160-7fdb7b0078b7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:59.699455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:59.737033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc62fe-949c-4e9f-849b-f7a48d6e79e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:59.737685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc62fe-949c-4e9f-849b-f7a48d6e79e2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:59.737967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc62fe-949c-4e9f-849b-f7a48d6e79e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:59.738243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc62fe-949c-4e9f-849b-f7a48d6e79e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:59.739391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc62fe-949c-4e9f-849b-f7a48d6e79e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:59.740852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc62fe-949c-4e9f-849b-f7a48d6e79e2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:59.742432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 72/140] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:03:59.748443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:03:59.795516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:03:59.869872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb838a-a57a-4f20-91d6-539a5e59fe67 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:03:59.908764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db1644-9b27-4e85-894b-c2d4ef980964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:03:59.909724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1644-9b27-4e85-894b-c2d4ef980964 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:03:59.910158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1644-9b27-4e85-894b-c2d4ef980964 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:03:59.910473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1644-9b27-4e85-894b-c2d4ef980964 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:03:59.914075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db1644-9b27-4e85-894b-c2d4ef980964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:03:59.917373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db1644-9b27-4e85-894b-c2d4ef980964 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:03:59.960208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 69/141] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:03:59 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:04:01.258394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd28c4-2ae3-404a-a8c2-c627b5b72ddd None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:01.258931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd28c4-2ae3-404a-a8c2-c627b5b72ddd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:01.258931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd28c4-2ae3-404a-a8c2-c627b5b72ddd None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:01.260313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 73/142] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:01.265882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3b27-2f6c-49ab-b623-a38de807fa1b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:01.266286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3b27-2f6c-49ab-b623-a38de807fa1b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:01.266468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3b27-2f6c-49ab-b623-a38de807fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:01.293484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a8ce3b27-2f6c-49ab-b623-a38de807fa1b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:01.294705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a8ce3b27-2f6c-49ab-b623-a38de807fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:01.352479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0a1a-5744-46c9-a3d6-11109378038b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:01.352837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0a1a-5744-46c9-a3d6-11109378038b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:01.353349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0a1a-5744-46c9-a3d6-11109378038b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:01.354980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 74/143] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:01.360809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e61a9f-5c14-41fe-b972-989c04feb106 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:01.361384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e61a9f-5c14-41fe-b972-989c04feb106 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:01.361750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e61a9f-5c14-41fe-b972-989c04feb106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:01.376289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 70/144] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:01.397202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-27e61a9f-5c14-41fe-b972-989c04feb106 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:01.398740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-27e61a9f-5c14-41fe-b972-989c04feb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:01.493156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 75/145] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:01.884379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a6d14-63e7-4285-a406-cfa63582ba5c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:01.884727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a6d14-63e7-4285-a406-cfa63582ba5c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:01.884934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a6d14-63e7-4285-a406-cfa63582ba5c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:01.886841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 71/146] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:01.892384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:01.892943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:01.893426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:01.916093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:01.918153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:02.005777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 76/147] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:02.014927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a6d14-63e7-4285-a406-cfa63582ba5c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.017688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.063499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:02.064376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:02.186611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a6d14-63e7-4285-a406-cfa63582ba5c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:02.191958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b18a8-878a-48ee-a4a1-e5ff8f97f6c5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:02.249618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072a503-d1e9-463a-be95-1d5403d8d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:02.250285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072a503-d1e9-463a-be95-1d5403d8d947 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.250560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072a503-d1e9-463a-be95-1d5403d8d947 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.250826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072a503-d1e9-463a-be95-1d5403d8d947 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.264662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890629a1-9900-449d-855d-a70c8781fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:02.265563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890629a1-9900-449d-855d-a70c8781fb1b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.266006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890629a1-9900-449d-855d-a70c8781fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.266857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890629a1-9900-449d-855d-a70c8781fb1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.269908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072a503-d1e9-463a-be95-1d5403d8d947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c072a503-d1e9-463a-be95-1d5403d8d947 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:02.275152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:02.276314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:02.277683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 77/148] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:02.278499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c625fb-505b-4338-aa98-67d1265af377 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.278936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c625fb-505b-4338-aa98-67d1265af377 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.279355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c625fb-505b-4338-aa98-67d1265af377 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.281479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 78/149] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:02.284067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c625fb-505b-4338-aa98-67d1265af377 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.288264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890629a1-9900-449d-855d-a70c8781fb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-890629a1-9900-449d-855d-a70c8781fb1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:02.297229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:02.298126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:02.298895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:02.300987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 72/150] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:02.302868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.303455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.303889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.336951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:02.338414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:02.427010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:02.448604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c625fb-505b-4338-aa98-67d1265af377 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:02.462545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 73/151] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:02.463403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.522525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:02.534339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:02.536449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.540404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.540713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.541447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:02.541758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:02.545417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:02.568457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 79/152] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:02.569421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.685777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb5111-d7be-48b1-87c7-c7300c335360 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:02.800675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:02.801308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.802986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.802986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.802986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:02.802986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:02.810704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:02.829501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a95ad0-fd95-412d-ab55-6762c0ad2bf5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:02.845084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 74/153] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:02.847959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.918755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:02.920624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:02.920905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:02.922735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:02.941328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:02.947685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:02.948666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:02.949426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 80/154] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:02.950299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:02.980633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:03.084785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:03.142092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d65eb8-26d1-4a9a-9a1b-d9b4e05a469f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:03.206033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4be3-990b-4b13-8125-a6412661991f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:03.240736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:03.241397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.241679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.241953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] PATH_INFO: `/v3/users/84677dff283a4e27afa450cf4325d25f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.247956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=84677dff283a4e27afa450cf4325d25f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:03.247956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:03.248234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 75/155] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/users/84677dff283a4e27afa450cf4325d25f => generated 247 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:03.248996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:03.279421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:03.280268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.281363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.281647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] PATH_INFO: `/v3/users/2cbe189ccd064fd7966f4119ef51636e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.283025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] RBAC: Authorizing `identity:get_user(user_id=2cbe189ccd064fd7966f4119ef51636e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:03.284654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:03.287167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 81/156] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:02 2022] GET /identity/v3/users/2cbe189ccd064fd7966f4119ef51636e => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:03.288281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:03.398051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:03.434766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2297f6-cd57-4904-b4ce-3dfb083bf86b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:03.471731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:03.472770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.473192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.473620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.485496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:03.492383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:03.493420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:03.494481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:03.497440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 82/157] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:03.498545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:03.509906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b20260-a0b1-41db-a55e-4ba3e583f9f4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:03.614022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66277-7dcc-4c4b-a26a-f65183c8b9f3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:03.625240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:03.625872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.626147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.626424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.627106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:03.627399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:03.628829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:03.651129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c4b74-0d79-4125-bc1c-7eb46fd1dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:03.652476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 76/158] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:03.653017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c4b74-0d79-4125-bc1c-7eb46fd1dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.653213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:03.658598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c4b74-0d79-4125-bc1c-7eb46fd1dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.659095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c4b74-0d79-4125-bc1c-7eb46fd1dcf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.672273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:03.684107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:03.734925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c4b74-0d79-4125-bc1c-7eb46fd1dcf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:03.736745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c4b74-0d79-4125-bc1c-7eb46fd1dcf0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:03.849249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 83/159] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:03.850972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd943e-c4a2-40d2-8a4c-73e2a7e0e069 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.851440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd943e-c4a2-40d2-8a4c-73e2a7e0e069 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.852031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd943e-c4a2-40d2-8a4c-73e2a7e0e069 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.853780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 84/160] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:03.854784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd943e-c4a2-40d2-8a4c-73e2a7e0e069 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:03.884881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3146-4ed2-41fd-afe4-5a10ed53a380 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:03.909637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:03.963091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:03.964149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:03.964587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:03.965003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:03.968075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:03.972227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:03.974098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 77/161] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:03 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:03.977197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:03.986016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd943e-c4a2-40d2-8a4c-73e2a7e0e069 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.052989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.053841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.056279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.056701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.057531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:04.060856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.062492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:04.074966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 85/162] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:04.076142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:04.131662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:04.167701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa0560-dab0-4dce-b290-211ae2a834da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.183637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ccfe-6b6b-41b1-88e4-8480608b3762 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.204382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:04.219254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a4f6-0b8b-4f66-ab3c-5cb61dd87ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.220209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a4f6-0b8b-4f66-ab3c-5cb61dd87ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.220840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a4f6-0b8b-4f66-ab3c-5cb61dd87ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.221534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a4f6-0b8b-4f66-ab3c-5cb61dd87ee7 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.222983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a4f6-0b8b-4f66-ab3c-5cb61dd87ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.224789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a4f6-0b8b-4f66-ab3c-5cb61dd87ee7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:04.226686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 86/163] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:04 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:04.228209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.228687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.229893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.249384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:04.250974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:04.281334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.282033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.282350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.282595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.283813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.285362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:04.286937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 78/164] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:03 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:04.292898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:04.366569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 87/165] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:04.367521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:04.469239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15d3e-9d8d-42f4-8caa-af5113dd7d91 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.500765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cccacf-1a8d-4a6b-958a-6e7bea101281 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.504297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:04.513642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.514332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.514617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.514891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163/users/2cbe189ccd064fd7966f4119ef51636e/roles/ba2a55ff43e847b3b060c16062a75c1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.516876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] RBAC: Authorizing `identity:create_grant(project_id=36d03b6452324c61890a85691e4e0163, user_id=2cbe189ccd064fd7966f4119ef51636e, role_id=ba2a55ff43e847b3b060c16062a75c1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.518326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:04.543965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.544788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.545161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.545532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.546801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.548713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:04.550962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 88/166] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:04 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:04.552007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:04.557375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 79/167] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:04:04 2022] PUT /identity/v3/projects/36d03b6452324c61890a85691e4e0163/users/2cbe189ccd064fd7966f4119ef51636e/roles/ba2a55ff43e847b3b060c16062a75c1e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:04.559451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:04.585829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:04.681542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028d82-02b7-4293-b593-50cccd09336f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.722271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.722824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.723213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.723489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.724275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=84677dff283a4e27afa450cf4325d25f) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:04.724581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.726118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae1e8-cc4e-47f0-af4e-7b524e54d8b4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:04.734228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 89/168] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:04 2022] GET /identity/v3/role_assignments?user.id=84677dff283a4e27afa450cf4325d25f&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:04.735876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6b33-4474-4840-b236-28f171ef71ca None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.736339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6b33-4474-4840-b236-28f171ef71ca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.736643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6b33-4474-4840-b236-28f171ef71ca None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.738409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 90/169] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:04.739205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f6b33-4474-4840-b236-28f171ef71ca None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:04.770263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19c5ba-5768-4ff4-8794-b5f8f3eb8dca None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.781687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:04.874696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0141f4-3581-4d7c-b158-ff1b4c3a6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:04.875343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0141f4-3581-4d7c-b158-ff1b4c3a6e77 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:04.875621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0141f4-3581-4d7c-b158-ff1b4c3a6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:04.875893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0141f4-3581-4d7c-b158-ff1b4c3a6e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:04.941281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f6b33-4474-4840-b236-28f171ef71ca None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:04.991667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0141f4-3581-4d7c-b158-ff1b4c3a6e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:04.993901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0141f4-3581-4d7c-b158-ff1b4c3a6e77 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:05.005314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:05.021042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab6721-55a9-419c-a6b6-e89c2a22e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:05.021748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab6721-55a9-419c-a6b6-e89c2a22e056 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.022032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab6721-55a9-419c-a6b6-e89c2a22e056 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.022302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab6721-55a9-419c-a6b6-e89c2a22e056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.131293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 80/170] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:05.137937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.138224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.138484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.160276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:05.161595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:05.169030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab6721-55a9-419c-a6b6-e89c2a22e056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:05.170535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab6721-55a9-419c-a6b6-e89c2a22e056 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:05.211093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:05.237262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 81/171] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:05.238454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.295140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 91/172] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:05.300500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78c75-8eeb-4922-89f4-a7af71589e93 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.301022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78c75-8eeb-4922-89f4-a7af71589e93 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.301022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78c75-8eeb-4922-89f4-a7af71589e93 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.302426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 92/173] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:05.304036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:05.305284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423961-6ea6-4c4d-9e06-290310bbf44a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.305284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423961-6ea6-4c4d-9e06-290310bbf44a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.305561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423961-6ea6-4c4d-9e06-290310bbf44a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.306861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 93/174] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:05.307449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9423961-6ea6-4c4d-9e06-290310bbf44a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.398428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5297-9b83-4294-831c-634db1c9b907 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:05.433322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:05.434304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.434983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.435253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.438880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9423961-6ea6-4c4d-9e06-290310bbf44a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:05.447265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:05.454434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:05.455310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:05.456155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:05.456760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 82/175] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:05.457318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.475834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:05.482630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ec74-fdb9-4c99-bf90-c31cfdab9709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:05.483460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ec74-fdb9-4c99-bf90-c31cfdab9709 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.483872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ec74-fdb9-4c99-bf90-c31cfdab9709 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.484304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ec74-fdb9-4c99-bf90-c31cfdab9709 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.485564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ec74-fdb9-4c99-bf90-c31cfdab9709 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:05.487137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ec74-fdb9-4c99-bf90-c31cfdab9709 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:05.488916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 94/176] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:05.490208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5825-ada4-4560-834d-643f154e4f95 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.490688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5825-ada4-4560-834d-643f154e4f95 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.491149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec5825-ada4-4560-834d-643f154e4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.510045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c0ec5825-ada4-4560-834d-643f154e4f95 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:05.512117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c0ec5825-ada4-4560-834d-643f154e4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:05.568577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:05.576702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c28f-80ba-4c60-800b-29a2ead66cfe None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:05.583963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 95/177] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:05.585124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.585413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.585678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.604057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:05.605310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:05.621293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:05.622248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.622733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.623244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.624694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:05.626423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:05.628646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 83/178] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:05.629677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.673919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 96/179] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:05.674949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.740341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:05.756440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3012a-9788-46cb-a9ff-e736aa3eac02 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:05.779853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d42286-ad91-4592-a20a-09514ad4cf09 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:05.820912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:05.821453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.821731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.822000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.822664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:05.822964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:05.824427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:05.826354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:05.827087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:05.827371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:05.827641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:05.828467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:05.829086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:05.830357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:05.833420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 84/180] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:05.834263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.842666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 97/181] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/role_assignments?user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=dd4261a805134646858c0ad93ba486fd => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:05.847976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:05.896360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.028704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc228d7-c558-40f0-85b7-a4504567bb44 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.030288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338f52-824c-403d-8014-e346d7fcdad3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.056464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.071356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.071903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.072206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.072478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.073310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] RBAC: Adding query filter params (role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:06.073620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.075048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.082073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 98/182] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/role_assignments?user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:06.088021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.101276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.102263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.102737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.103159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.125171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:06.132533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:06.133518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:06.134328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 85/183] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:06.134996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.237760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94aab0-b716-4e46-aa2d-1be1e6051bfb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.276669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.284829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.285485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.285762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.286036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] PATH_INFO: `/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.287194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] RBAC: Authorizing `identity:get_user(user_id=6e0dc09ddedf4d0e950ee4460e0bc2c9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.288705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.290921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 99/184] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/users/6e0dc09ddedf4d0e950ee4460e0bc2c9 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:06.290921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.303756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e56bc-ee73-4d1f-82eb-6d13bdc6b1c4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.350343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.350914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.351190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.351457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.364745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:06.365294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:06.370316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:06.371210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:06.372436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 86/185] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:06.373165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.420709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99dea7-3e04-4ad9-8f9b-b657ab1ffb72 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.462118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.463156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.463454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.463795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.465324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.467090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.468695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 100/186] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:06.469463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.492976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00269391-cf25-4c99-ad8b-dbac8ebe704a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.530946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.531881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.532422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.532832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.533667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:06.534105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.535636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.544470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 87/187] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:06.545511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.561451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.574682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac12295-a71e-4593-a5bc-0cc748671610 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.598334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.609889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.610439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.610723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.610998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.659509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a5a9-097e-4adc-ab24-4809fc24e53c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.686205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.687696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.697409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.698092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.698372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.698646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.699320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:06.699621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.701027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.714694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 88/188] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:06.715763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.786337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.793439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 101/189] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:06.794292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.821098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:06.830608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a5e1c-b209-4817-a0b4-61b3ac5d51d2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.866407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.866944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.867225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.867495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.868426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.869631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.891031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 89/190] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:06 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:06.891854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:06.914303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ced2c-a51a-473e-9894-29f383eb9bb7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:06.961278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:06.962014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:06.962206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:06.962482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] PATH_INFO: `/v3/users/51307bbd17ad4e8c8be32b02e3762d04` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:06.979606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] RBAC: Authorizing `identity:get_user(user_id=51307bbd17ad4e8c8be32b02e3762d04)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:06.981490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:06.983512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 102/191] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/users/51307bbd17ad4e8c8be32b02e3762d04 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:06.984365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.032328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d52ff-1f5b-4ff8-a0d2-1c4a3c8a72b0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:07.072183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.085044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.086166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:07.087288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.087615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.087845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] PATH_INFO: `/v3/users/51307bbd17ad4e8c8be32b02e3762d04` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.089969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] RBAC: Authorizing `identity:get_user(user_id=51307bbd17ad4e8c8be32b02e3762d04)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:07.091837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:07.094203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 90/192] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/users/51307bbd17ad4e8c8be32b02e3762d04 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:07.095090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.117472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d52c8a-2575-4a15-84dc-a9365fa5e658 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:07.159076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:07.159714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.160020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.160293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] PATH_INFO: `/v3/projects/aad3e0416dcd4d8499be67ee283be84c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.161416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] RBAC: Authorizing `identity:get_project(project_id=aad3e0416dcd4d8499be67ee283be84c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:07.163224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:07.164738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 103/193] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:06 2022] GET /identity/v3/projects/aad3e0416dcd4d8499be67ee283be84c => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:07.165302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.231530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c46f9-7849-4b6b-bed0-ff7fcb866812 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:07.278248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cc85e-9850-4d1d-9738-f547c09017f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:07.279162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cc85e-9850-4d1d-9738-f547c09017f8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.279447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cc85e-9850-4d1d-9738-f547c09017f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.279858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cc85e-9850-4d1d-9738-f547c09017f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.289893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992e02-b7b8-446a-a53d-b873e05a566b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:07.330141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:07.330837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.331122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.331393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.356708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.359524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.364409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cc85e-9850-4d1d-9738-f547c09017f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:07.366409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cc85e-9850-4d1d-9738-f547c09017f8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:07.418012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:07.420315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:07.475526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 91/194] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:07.477096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c3ac-0f09-4724-8e7b-3ecdfdb0bcfa None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.477455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c3ac-0f09-4724-8e7b-3ecdfdb0bcfa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.477806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c3ac-0f09-4724-8e7b-3ecdfdb0bcfa None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.479431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 92/195] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:07.484065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c3ac-0f09-4724-8e7b-3ecdfdb0bcfa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.558292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 104/196] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:07.559169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.598090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.607396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c3ac-0f09-4724-8e7b-3ecdfdb0bcfa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:07.618985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.653455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:07.654076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.654357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.654632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.655367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=aad3e0416dcd4d8499be67ee283be84c, user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:07.655841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:07.657838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcda9f-23e7-4a64-b1fa-2bd1215ae02a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:07.665299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 93/197] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:07 2022] GET /identity/v3/role_assignments?user.id=6e0dc09ddedf4d0e950ee4460e0bc2c9&scope.project.id=aad3e0416dcd4d8499be67ee283be84c&role.id=dd4261a805134646858c0ad93ba486fd => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:07.667372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.667652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.667922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.679261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e38a-2dfb-41a7-b960-7842589163a3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:07.692234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:07.693770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:07.739471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:07.740161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:07.740440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:07.740714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:07.741979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:07.743461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:07.747069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 105/198] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:07 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:07.758128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.845613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 94/199] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:07.846519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:07.980147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:07.997474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad741c-9e03-4228-9df9-d097f46c73c1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:08.001018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc93cdd-a516-48aa-a02d-dfc3c361a518 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:08.036588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:08.043190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:08.044584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:08.045072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:08.045569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:08.047261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=51307bbd17ad4e8c8be32b02e3762d04) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:08.047850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:08.049536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:08.056721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 95/200] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:07 2022] GET /identity/v3/role_assignments?user.id=51307bbd17ad4e8c8be32b02e3762d04&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:08.079900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:08.080573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:08.080850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:08.081121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:08.082250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:08.083690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:08.085659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 106/201] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:07 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:08.092415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:08.174748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:08.274954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1396d5-94f5-469b-9dd5-f72c9c54c690 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:08.334500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:08.335359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:08.335814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:08.336252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:08.337120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] RBAC: Adding query filter params (role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=51307bbd17ad4e8c8be32b02e3762d04) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:08.337670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:08.339798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:08.347594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 96/202] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:08 2022] GET /identity/v3/role_assignments?user.id=51307bbd17ad4e8c8be32b02e3762d04&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:08.357347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec71d5-d30f-48f7-ba2d-ffda1332f6bb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:08.407669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a68105-d341-4944-ae11-931d523da69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:08.408362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a68105-d341-4944-ae11-931d523da69a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:08.408641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a68105-d341-4944-ae11-931d523da69a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:08.408914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a68105-d341-4944-ae11-931d523da69a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:08.421822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a68105-d341-4944-ae11-931d523da69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-24a68105-d341-4944-ae11-931d523da69a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:08.427301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:08.428288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:08.429089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 107/203] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:08.434735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:08.472321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:08.596407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534eec-6527-4f47-a3fa-702f5035454a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:08.632144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:08.632762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:08.633043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:08.633322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:08.633986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:08.634289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:08.636291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:08.644916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 97/204] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:08.651545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a68105-d341-4944-ae11-931d523da69a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:08.723322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:08.797492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a68105-d341-4944-ae11-931d523da69a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:08.851012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:08.851580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:08.851861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:08.852164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] PATH_INFO: `/v3/users/2cbe189ccd064fd7966f4119ef51636e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:08.853315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] RBAC: Authorizing `identity:get_user(user_id=2cbe189ccd064fd7966f4119ef51636e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:08.854822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:08.857686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 108/205] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:08 2022] GET /identity/v3/users/2cbe189ccd064fd7966f4119ef51636e => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:08.862360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:08.975458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:09.002161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e6180-2145-4eb9-9479-b02e9a2b440c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:09.051472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:09.052168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.052453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.052732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.146659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:09.148108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:09.252089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:09.278014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 98/206] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:09.283655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:09.400549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355fb3e-56bd-4dd1-921f-71130b1be3aa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:09.423184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:09.450765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd4b93-a5cf-4d3c-8923-3735926a697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:09.451467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4b93-a5cf-4d3c-8923-3735926a697b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.451754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4b93-a5cf-4d3c-8923-3735926a697b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.452047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4b93-a5cf-4d3c-8923-3735926a697b None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.453299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd4b93-a5cf-4d3c-8923-3735926a697b None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:09.454737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd4b93-a5cf-4d3c-8923-3735926a697b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:09.456570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 109/207] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:09 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:09.462294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:09.593746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b6ad-5d12-4cfb-9321-d99330ab5c19 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:09.631349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:09.631984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.632265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.632534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.633271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] RBAC: Adding query filter params (role.id=ba2a55ff43e847b3b060c16062a75c1e, scope.project.id=36d03b6452324c61890a85691e4e0163, user.id=2cbe189ccd064fd7966f4119ef51636e) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:09.633576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:09.635011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b37c-6445-4191-b660-aa3e04fbb6b8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:09.641363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 99/208] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:09 2022] GET /identity/v3/role_assignments?user.id=2cbe189ccd064fd7966f4119ef51636e&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=ba2a55ff43e847b3b060c16062a75c1e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:09.710650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb37c1-0887-4561-8c40-775fb684c6f5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.711155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb37c1-0887-4561-8c40-775fb684c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.711155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb37c1-0887-4561-8c40-775fb684c6f5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.712793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 110/209] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:09.719310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b27a9-d551-4fd5-958f-12f9ac3f82ee None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.719602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b27a9-d551-4fd5-958f-12f9ac3f82ee None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.719862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b27a9-d551-4fd5-958f-12f9ac3f82ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.739586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a74b27a9-d551-4fd5-958f-12f9ac3f82ee None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:09.745734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a74b27a9-d551-4fd5-958f-12f9ac3f82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:09.795056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:09.842321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 100/210] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:09.862214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd2af-7e70-4acd-8592-c4bd76c4bc8c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.862545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd2af-7e70-4acd-8592-c4bd76c4bc8c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.862753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd2af-7e70-4acd-8592-c4bd76c4bc8c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.864154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 111/211] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:09.870371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:09.870852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:09.870952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:09.890205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:09.891374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:09.960409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 101/212] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:10.167084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd2af-7e70-4acd-8592-c4bd76c4bc8c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:10.244111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:10.283791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd2af-7e70-4acd-8592-c4bd76c4bc8c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:10.322920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:10.323560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.323834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.324157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.337701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:10.343330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:10.344253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:10.345083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 112/213] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:10.351611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:10.373752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a2cef-cdda-40ac-8700-18bb1ebd7fd8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:10.375457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:10.402117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:10.422843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:10.423655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.423943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.424222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.425971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:10.427513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:10.430252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 102/214] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:10.436641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:10.467339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f81ab-b55f-40a2-a935-91bb6557790b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:10.506517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:10.507276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.507679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.508087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.508939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:10.509404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:10.510925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:10.521016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 113/215] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:10.527277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:10.559712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe920bc-edd0-4639-b9f9-72d3f44f5ec4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:10.599107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eccfd-6d94-4488-a17d-eae4ab3bccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:10.599668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eccfd-6d94-4488-a17d-eae4ab3bccad None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.599968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eccfd-6d94-4488-a17d-eae4ab3bccad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.600236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eccfd-6d94-4488-a17d-eae4ab3bccad None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.600889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eccfd-6d94-4488-a17d-eae4ab3bccad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:10.602494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eccfd-6d94-4488-a17d-eae4ab3bccad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:10.627310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 103/216] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:10 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:10.654678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d360-7d31-4ae9-9fa7-698b57f5d7d2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:10.658223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:10.688056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c6d3-2abd-4626-8440-d6a753b9eab7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.688663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c6d3-2abd-4626-8440-d6a753b9eab7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.689142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c6d3-2abd-4626-8440-d6a753b9eab7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.691307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 104/217] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:10.695796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:10.696572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.696859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.697137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] PATH_INFO: `/v3/users/b495ee50aa284dc384ccc4b3b11715f4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.698937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014a6b0-999a-40e9-90b1-1b9f71073765 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.699218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014a6b0-999a-40e9-90b1-1b9f71073765 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.699498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014a6b0-999a-40e9-90b1-1b9f71073765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.714540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] RBAC: Authorizing `identity:get_user(user_id=b495ee50aa284dc384ccc4b3b11715f4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:10.716071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:10.718233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 114/218] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:10 2022] GET /identity/v3/users/b495ee50aa284dc384ccc4b3b11715f4 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:10.724597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:10.724798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6014a6b0-999a-40e9-90b1-1b9f71073765 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:10.726011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6014a6b0-999a-40e9-90b1-1b9f71073765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:10.749545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:10.819982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 105/219] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:10.858163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798526f-9dc8-498b-a357-69179d63416d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:10.899723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:10.900376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.900656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.901503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.933482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:10.974624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:10.976045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:10.988761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b2d4c-cbba-4e39-b3fc-3f7a023c441c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.989238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b2d4c-cbba-4e39-b3fc-3f7a023c441c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.989311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b2d4c-cbba-4e39-b3fc-3f7a023c441c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:10.990911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 106/220] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:10.996680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:10.996979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:10.997249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.020960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:11.022278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:11.097399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 115/221] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:11.104731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.118621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 107/222] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:11.125077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.173364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:11.229918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795256a-c14b-4fd7-939b-c19a1c553744 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.278981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.279714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.280022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.280380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.285153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:11.286607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:11.292786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 116/223] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:11.296265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.305016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:11.323596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ff90-494c-4ac4-b968-865db49250fe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.385096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.386388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.386666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.386929 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.406554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:11.412643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:11.413543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:11.414928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 108/224] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:11.420330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.472864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f336-56b3-4ca8-a43e-9376c7df143a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.506411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:11.513972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.514835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.515188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.516090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.516860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=b495ee50aa284dc384ccc4b3b11715f4) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:11.517170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:11.518615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:11.535178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 117/225] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/role_assignments?user.id=b495ee50aa284dc384ccc4b3b11715f4&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=dd4261a805134646858c0ad93ba486fd => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:11.536800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.592386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c37d6-0270-4b11-8b2c-51e38966de68 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.664386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752c09b-27b4-4e52-b9d9-33e1e3826eb5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.680941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.681773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.682610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.682774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.683456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:11.683761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:11.685222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:11.711920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 109/226] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:11.713629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.717396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.719124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.719404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.719677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.738957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:11.743961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:11.753290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:11.754264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:11.755070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 118/227] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:11.762910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:11.883586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:11.894403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef72e5b-0272-411d-842b-b05d3415b258 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.948980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28f2da-f71f-4d76-a7ee-027666e5b5e7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:11.980598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.981250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.981530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.981799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] PATH_INFO: `/v3/users/51307bbd17ad4e8c8be32b02e3762d04` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.982554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:11.983259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:11.983634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:11.984047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:11.984810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:11.985210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:11.986690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:11.988648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] RBAC: Authorizing `identity:get_user(user_id=51307bbd17ad4e8c8be32b02e3762d04)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:11.990120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:11.992167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 110/228] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/users/51307bbd17ad4e8c8be32b02e3762d04 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:12.001007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 119/229] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:12.002668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:12.007514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:12.121849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206be217-c475-4b43-bbf9-2c8dcb952750 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:12.143969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:12.158880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:12.159691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:12.160669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:12.161149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:12.161621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] PATH_INFO: `/v3/users/51307bbd17ad4e8c8be32b02e3762d04` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:12.162932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] RBAC: Authorizing `identity:get_user(user_id=51307bbd17ad4e8c8be32b02e3762d04)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:12.164870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:12.167692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 120/230] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:12 2022] GET /identity/v3/users/51307bbd17ad4e8c8be32b02e3762d04 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:12.173357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:12.212472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcd426-f431-4e0f-8c11-135a369663ee None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:12.280295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:12.281311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:12.281839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:12.282302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:12.284342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:12.287371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:12.290209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 111/231] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:12 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:12.297663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:12.329637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0aaca-737c-4ecd-93b0-43b5ebbc636d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:12.364866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:12.365918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:12.366455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:12.366919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:12.368297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:12.370037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:12.372350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 121/232] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:12 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:12.383417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:12.446286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:12.489622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7932e5-cfa0-4ea1-a062-83080bf61943 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:12.509092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61c3c-89e7-4a89-af7a-952457a20a4f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:12.528113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4888c8-9f29-422f-b18d-ee9ca1b5c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:12.529115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4888c8-9f29-422f-b18d-ee9ca1b5c30d None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:12.529621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4888c8-9f29-422f-b18d-ee9ca1b5c30d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:12.530486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4888c8-9f29-422f-b18d-ee9ca1b5c30d None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f/users/51307bbd17ad4e8c8be32b02e3762d04/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:12.532858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4888c8-9f29-422f-b18d-ee9ca1b5c30d None admin] RBAC: Authorizing `identity:create_grant(project_id=76e2202316cd48b390f80fdc501b381f, user_id=51307bbd17ad4e8c8be32b02e3762d04, role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:12.534871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4888c8-9f29-422f-b18d-ee9ca1b5c30d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:12.549458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 122/233] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:04:12 2022] PUT /identity/v3/projects/76e2202316cd48b390f80fdc501b381f/users/51307bbd17ad4e8c8be32b02e3762d04/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:12.578299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68114d46-a0ed-4e54-a3db-5064388114b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:12.579335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114d46-a0ed-4e54-a3db-5064388114b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:12.579807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114d46-a0ed-4e54-a3db-5064388114b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:12.580356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68114d46-a0ed-4e54-a3db-5064388114b0 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f/users/51307bbd17ad4e8c8be32b02e3762d04/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:12.584973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68114d46-a0ed-4e54-a3db-5064388114b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=76e2202316cd48b390f80fdc501b381f, user_id=51307bbd17ad4e8c8be32b02e3762d04, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:12.586733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68114d46-a0ed-4e54-a3db-5064388114b0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:12.603719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 112/234] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:04:12 2022] PUT /identity/v3/projects/76e2202316cd48b390f80fdc501b381f/users/51307bbd17ad4e8c8be32b02e3762d04/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:04:13.330961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922e5e-1b51-4fca-b134-f67b3cc7e167 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:13.331522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922e5e-1b51-4fca-b134-f67b3cc7e167 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:13.331522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922e5e-1b51-4fca-b134-f67b3cc7e167 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:13.333402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 123/235] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:13.339844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff17f5-e2a8-4b86-8477-a5f3df89e97e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:13.340385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff17f5-e2a8-4b86-8477-a5f3df89e97e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:13.340488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff17f5-e2a8-4b86-8477-a5f3df89e97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:13.349123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:13.362109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-26ff17f5-e2a8-4b86-8477-a5f3df89e97e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:13.363334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-26ff17f5-e2a8-4b86-8477-a5f3df89e97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:13.460619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 113/236] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:13.467825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90547d-cde8-4656-874a-414076be50ed None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:13.468141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90547d-cde8-4656-874a-414076be50ed None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:13.468421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90547d-cde8-4656-874a-414076be50ed None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:13.469755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 124/237] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:13.475093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:13.475386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:13.475665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:13.501852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:13.503073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:13.597955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 114/238] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:13.742356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90547d-cde8-4656-874a-414076be50ed None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:13.880724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:13.883386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90547d-cde8-4656-874a-414076be50ed None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:13.909206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:13.955480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:13.956177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:13.956460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:13.956735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:13.958963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:13.960510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:13.962541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 125/239] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:13.968679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:13.997973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:14.066436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91b8f8-6009-4981-ac85-967cb84bb57f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:14.116743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:14.117399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.117681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.118017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.130665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:14.139106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:14.140027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:14.140821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 115/240] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:14.155956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:14.198727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e5d75-d613-4dd6-ba8b-fc62f21986cf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:14.243719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c57214-641b-4ca1-a224-6556bdbc1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:14.245220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c57214-641b-4ca1-a224-6556bdbc1e28 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.245763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c57214-641b-4ca1-a224-6556bdbc1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.246041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c57214-641b-4ca1-a224-6556bdbc1e28 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.246704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c57214-641b-4ca1-a224-6556bdbc1e28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:14.248175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c57214-641b-4ca1-a224-6556bdbc1e28 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:14.269785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2388-e65d-438c-ab22-5a3692bc745e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:14.274829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 126/241] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:13 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:04:14.276675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0da73-3ba8-49d4-a030-2fd6083fb260 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.276959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0da73-3ba8-49d4-a030-2fd6083fb260 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.277230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0da73-3ba8-49d4-a030-2fd6083fb260 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.280025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 127/242] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:14.284594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.284961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.285302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.303883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:14.305595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:14.307579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:14.317497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:14.318116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.318391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.318659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.319335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:14.319634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:14.321082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:14.330990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 116/243] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:14.336748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:14.348214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:14.403902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 128/244] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:14.492091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7244dfa-5882-48aa-86e1-f27c9d8f2673 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:14.528812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:14.529465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.529746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.530017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] PATH_INFO: `/v3/users/59a903609d9b4c48be535e560cd38b22` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.544812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] RBAC: Authorizing `identity:get_user(user_id=59a903609d9b4c48be535e560cd38b22)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:14.546379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:14.548344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 117/245] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:14 2022] GET /identity/v3/users/59a903609d9b4c48be535e560cd38b22 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:14.554019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:14.658370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9c100-a1f8-4aca-bc9a-4193c7853fc1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:14.699781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:14.700433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.700716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.700988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.726411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:14.742038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:14.785274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:14.786744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:14.803272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:14.874596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ced1a-9580-44bc-b0f9-6a968255f10f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:14.908946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 129/246] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:14.913313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:14.914146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:14.914427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:14.914828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:14.915242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:14.926981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:14.933777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:14.934888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:14.935727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:14.937878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 118/247] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:14.943659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:14.991017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:15.036885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685efa-ff94-4ba5-8de0-e3f18375eef7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:15.080693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:15.081831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.082381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.082796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.084209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:15.085871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:15.086032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7669589-a963-4f29-bf39-541c4c905389 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:15.089938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:15.090968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 130/248] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:14 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:15.099761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:15.135917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:15.136668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.136952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.137231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.138168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:15.138478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:15.140803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:15.152561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 119/249] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:15.158288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:15.235052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa9f3-d3ed-442e-9d1d-47f77be2ec2c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:15.275055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:15.275702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.276006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.276279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.283075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] RBAC: Adding query filter params (role.id=ba2a55ff43e847b3b060c16062a75c1e, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=59a903609d9b4c48be535e560cd38b22) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:15.283288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:15.284718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:15.286887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:15.289350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a430-b81c-4323-bfa0-5bd0b0440152 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:15.301198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 131/250] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:15 2022] GET /identity/v3/role_assignments?user.id=59a903609d9b4c48be535e560cd38b22&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=ba2a55ff43e847b3b060c16062a75c1e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:15.348823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7098f4-c559-4387-a7e9-fe64cb29ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:15.349884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7098f4-c559-4387-a7e9-fe64cb29ddeb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.350403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7098f4-c559-4387-a7e9-fe64cb29ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.350881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7098f4-c559-4387-a7e9-fe64cb29ddeb None admin] PATH_INFO: `/v3/users/b495ee50aa284dc384ccc4b3b11715f4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.352487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7098f4-c559-4387-a7e9-fe64cb29ddeb None admin] RBAC: Authorizing `identity:get_user(user_id=b495ee50aa284dc384ccc4b3b11715f4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:15.354757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7098f4-c559-4387-a7e9-fe64cb29ddeb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:15.356751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 120/251] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:15 2022] GET /identity/v3/users/b495ee50aa284dc384ccc4b3b11715f4 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:15.363237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:15.506615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c103d23-e12e-4f3f-8d3a-ffad9da114f5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:15.530800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb64fad-90b2-4d11-87bd-ef7ae39714e5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.531348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb64fad-90b2-4d11-87bd-ef7ae39714e5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.531348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb64fad-90b2-4d11-87bd-ef7ae39714e5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.532847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 121/252] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:15.541735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db036bf5-fd74-4109-87b4-a981733191e7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.542735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db036bf5-fd74-4109-87b4-a981733191e7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.543219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db036bf5-fd74-4109-87b4-a981733191e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.563568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:15.564246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.564591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.564868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.571995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:15.571995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:15.573089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 132/253] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:15 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:15.579121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-db036bf5-fd74-4109-87b4-a981733191e7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:15.579297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:15.580801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db036bf5-fd74-4109-87b4-a981733191e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:15.626079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:15.699303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 122/254] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:15.701032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cfea4-6f3b-4cd0-af9f-ea07598a887f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.701493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cfea4-6f3b-4cd0-af9f-ea07598a887f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.701911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cfea4-6f3b-4cd0-af9f-ea07598a887f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.703557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 123/255] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:15.714049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:15.723150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.723660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.724105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.757814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:15.759220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:15.769171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae57eb-02f7-40fb-b032-d0da06790110 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:15.811330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:15.816048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:15.817161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:15.817583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f/users/b495ee50aa284dc384ccc4b3b11715f4/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:15.821021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] RBAC: Authorizing `identity:create_grant(project_id=76e2202316cd48b390f80fdc501b381f, user_id=b495ee50aa284dc384ccc4b3b11715f4, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:15.824552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:15.848099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 133/256] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:04:15 2022] PUT /identity/v3/projects/76e2202316cd48b390f80fdc501b381f/users/b495ee50aa284dc384ccc4b3b11715f4/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:04:15.887838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 124/257] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:16.144189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.260608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7810c0-5e2b-48fa-a1aa-afb3e17eac5f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:16.289150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:16.289456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.301308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:16.301993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:16.302276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:16.302550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:16.323453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:16.329187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:16.330076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:16.331303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 134/258] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:16.337541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.463183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:16.481070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19486f-4df8-491e-ab9d-90ae7960c638 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:16.536025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4859eb-fecf-4737-b3f5-e7dc12a42679 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:16.563103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:16.563834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:16.564045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:16.564314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:16.583889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:16.588843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:16.589422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:16.590277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:16.591285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:16.592135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:16.592135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:16.592135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:16.592135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:16.592417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 125/259] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:16.592494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:16.592783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:16.599967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.605270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 135/260] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:16.612212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.703000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:16.820385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31047fad-0c5d-4860-a185-0d0335fd1bd9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:16.826757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea713810-0bdc-483c-9e7e-a1ea04a2de09 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:16.903797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:16.904442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:16.904720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:16.904990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:16.905659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:16.905958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:16.907329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:16.911742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:16.912402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:16.912682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:16.912955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] PATH_INFO: `/v3/users/51307bbd17ad4e8c8be32b02e3762d04` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:16.914068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] RBAC: Authorizing `identity:get_user(user_id=51307bbd17ad4e8c8be32b02e3762d04)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:16.916728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:16.918558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 136/261] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/users/51307bbd17ad4e8c8be32b02e3762d04 => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:16.926876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.936274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 126/262] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:16.941724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:16.981659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:17.143966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189a44c-6599-492d-9b67-ac86bf9c5f5d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:17.162746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490225-78ad-4f03-addf-fdddc6d9840c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:17.175587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:17.211520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:17.212358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:17.212567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:17.213377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:17.232058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:17.232697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:17.232971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:17.233237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] PATH_INFO: `/v3/users/51307bbd17ad4e8c8be32b02e3762d04` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:17.234355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] RBAC: Authorizing `identity:get_user(user_id=51307bbd17ad4e8c8be32b02e3762d04)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:17.235783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:17.242436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 127/263] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/users/51307bbd17ad4e8c8be32b02e3762d04 => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:17.243293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:17.291021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:17.292504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:17.400173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 137/264] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:17.408267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:17.409075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:17.427442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185847f-70ce-445e-a258-f9c6c489acf6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:17.445560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:17.481771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:17.482386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:17.482668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:17.482936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:17.556208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:17.557805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:17.639289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60abd86-e38b-49ac-b46b-c1ad1fa3f2d2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:17.660756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:17.674191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 128/265] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:17.679537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:17.707164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:17.708126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:17.710578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:17.711000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:17.713361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:17.714945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:17.718158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 138/266] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:17 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:17.725243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:17.855982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:17.874935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f4ea-c3c4-44bb-9fb5-b39a595d474d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:17.885694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2678-0bce-4318-a07b-d69a718c6b96 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:17.914574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:17.915414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:17.915884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:17.916381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:17.917268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=51307bbd17ad4e8c8be32b02e3762d04) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:17.917716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:17.919336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:17.926012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 139/267] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:17 2022] GET /identity/v3/role_assignments?user.id=51307bbd17ad4e8c8be32b02e3762d04&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:17.964801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127747ad-8a87-4c70-a7d1-6cee981a4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:17.965473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127747ad-8a87-4c70-a7d1-6cee981a4544 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:17.965754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127747ad-8a87-4c70-a7d1-6cee981a4544 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:17.966029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127747ad-8a87-4c70-a7d1-6cee981a4544 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:17.967285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127747ad-8a87-4c70-a7d1-6cee981a4544 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:17.968788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127747ad-8a87-4c70-a7d1-6cee981a4544 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:17.970529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 129/268] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:17 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:17.976725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:18.102840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073e9bf-655d-4056-9f1b-f7f9a114115d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:18.143172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:18.143810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.144963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.145500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.146245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] RBAC: Adding query filter params (role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=51307bbd17ad4e8c8be32b02e3762d04) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:18.146550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:18.148049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bceb13-a6c1-4a7d-9c38-34f41bab5fe1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:18.155193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 140/269] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:17 2022] GET /identity/v3/role_assignments?user.id=51307bbd17ad4e8c8be32b02e3762d04&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:18.258895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad292d-3d53-442e-b254-943e564a9552 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.259276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad292d-3d53-442e-b254-943e564a9552 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.259437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad292d-3d53-442e-b254-943e564a9552 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.261838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 130/270] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:18.267723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32a39f-cb7b-48ab-be7d-d148401cbfee None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.268382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32a39f-cb7b-48ab-be7d-d148401cbfee None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.268852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32a39f-cb7b-48ab-be7d-d148401cbfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.294024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0b32a39f-cb7b-48ab-be7d-d148401cbfee None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:18.295617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0b32a39f-cb7b-48ab-be7d-d148401cbfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:18.304649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:18.380349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 141/271] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:18.459411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84225-12df-455b-ac18-191f7a85f0ad None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.459916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84225-12df-455b-ac18-191f7a85f0ad None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.460381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd84225-12df-455b-ac18-191f7a85f0ad None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.462232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 131/272] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:18.468181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.468694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.469134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.488826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:18.490313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:18.509242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e9f9-d374-438b-9f19-aa023b3dbc1e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.509858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e9f9-d374-438b-9f19-aa023b3dbc1e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.510397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e9f9-d374-438b-9f19-aa023b3dbc1e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.512323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 132/273] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:18.518489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.519032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.519505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.543223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:18.544772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:18.573441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 142/274] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:18.604868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:18.628059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 133/275] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:18.710362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:18.780928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:18.816355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043845ff-11f6-456d-bfe4-c8832cb61c9f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:18.854679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:18.855310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:18.855587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:18.855864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:18.866038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:18.871537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:18.872430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:18.873300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:18.879687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 143/276] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:18.881028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:18.891333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:18.998251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e6b2-112d-40aa-aa26-ebf5dcba5587 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.003497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad591b-c95b-4cf9-b25b-02c5b9665064 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.034070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.037906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.038526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.038806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.039077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.039426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.039740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:19.040070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.040176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.040362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.040620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.041964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.042246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.043802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.048040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 144/277] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:19.048040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.057300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 134/278] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:19.057300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.105398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.149925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72465e-42c8-4d95-bc2c-b0b3ed01c2ec None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.159667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa1db-9a59-4382-b203-186037c20607 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.182992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.183615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.183892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.184198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.192045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8abae9-95ac-493b-a2fc-2b0ff04b0ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.192650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8abae9-95ac-493b-a2fc-2b0ff04b0ddb None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.192932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8abae9-95ac-493b-a2fc-2b0ff04b0ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.193261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8abae9-95ac-493b-a2fc-2b0ff04b0ddb None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.193902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8abae9-95ac-493b-a2fc-2b0ff04b0ddb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.194498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:19.195362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8abae9-95ac-493b-a2fc-2b0ff04b0ddb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:19.200318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:19.201407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 145/279] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:19.202270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.218583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 135/280] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:19 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:19.219699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba32db-7016-4698-b985-97ebb7ac1bb2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.220013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba32db-7016-4698-b985-97ebb7ac1bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.220288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba32db-7016-4698-b985-97ebb7ac1bb2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.221508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 136/281] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:19.222225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba32db-7016-4698-b985-97ebb7ac1bb2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.287980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.331895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.335953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f374d-01bc-4568-b100-910621acefff None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.336942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba32db-7016-4698-b985-97ebb7ac1bb2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.373102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.373753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.373977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.374104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.374299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] PATH_INFO: `/v3/users/2b53e63fae4a4c9cb02b94fb6c998837` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.374604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.374885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.375162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.375842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:19.376177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.377592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79e4b-254a-40b3-9066-a0c8ba243fe9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.387919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 137/282] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:19.389174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.389464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.389783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.393713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] RBAC: Authorizing `identity:get_user(user_id=2b53e63fae4a4c9cb02b94fb6c998837)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.395438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.397149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 146/283] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/users/2b53e63fae4a4c9cb02b94fb6c998837 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:19.397914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.414111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:19.415312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:19.499981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 138/284] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:19.501298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.517683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e500e1-ee7f-4845-9155-d361cf9e92ac None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.543362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.562863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.563476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.563753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.564054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] PATH_INFO: `/v3/users/59a903609d9b4c48be535e560cd38b22` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.565337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] RBAC: Authorizing `identity:get_user(user_id=59a903609d9b4c48be535e560cd38b22)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.567085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.568861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 147/285] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/users/59a903609d9b4c48be535e560cd38b22 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:19.574660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.615656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.626235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e177-1648-4c14-99bd-a230927e759f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.666218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.666982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.667259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.667523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.668308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, user.id=2b53e63fae4a4c9cb02b94fb6c998837, scope.system=all) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:19.668988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.670269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.676987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 139/286] 10.222.0.27 () {56 vars in 1308 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/role_assignments?user.id=2b53e63fae4a4c9cb02b94fb6c998837&scope.system=all&role.id=dd4261a805134646858c0ad93ba486fd => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:19.706805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be21d-9850-4a25-8c70-df784c8ac09a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.749859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.750602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.750784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.751051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.752309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:19.753775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:19.755974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 148/287] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:19.762044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.796671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:19.903043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:19.917594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc728-7ed8-43af-a58b-3fd34b781de2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.967914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8dbb6-3da0-415a-b48c-b273dfb75206 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:19.989229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:19.989914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:19.990190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:19.990462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f/users/59a903609d9b4c48be535e560cd38b22/roles/ba2a55ff43e847b3b060c16062a75c1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:19.999732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] RBAC: Authorizing `identity:create_grant(project_id=76e2202316cd48b390f80fdc501b381f, user_id=59a903609d9b4c48be535e560cd38b22, role_id=ba2a55ff43e847b3b060c16062a75c1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:20.001410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:20.004444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:20.005336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:20.005855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:20.006325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:20.018086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:20.024863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:20.027044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:20.027993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:20.031230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 149/288] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:20.036934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:20.046108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 140/289] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:04:19 2022] PUT /identity/v3/projects/76e2202316cd48b390f80fdc501b381f/users/59a903609d9b4c48be535e560cd38b22/roles/ba2a55ff43e847b3b060c16062a75c1e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:04:20.167883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4f98-e74b-4ce7-a0bc-b398fbbb12d8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:20.185040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:20.214950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:20.215742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:20.216173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:20.216544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:20.217335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:20.217807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:20.219313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:20.230901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 150/290] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:20.236609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:20.265432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:20.358985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da1997-34f1-4d18-a891-c8896c906c09 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:20.397894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:20.398533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:20.398850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:20.399134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] PATH_INFO: `/v3/users/b495ee50aa284dc384ccc4b3b11715f4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:20.400336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] RBAC: Authorizing `identity:get_user(user_id=b495ee50aa284dc384ccc4b3b11715f4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:20.401854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:20.403742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 141/291] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:20 2022] GET /identity/v3/users/b495ee50aa284dc384ccc4b3b11715f4 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:20.409190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:20.574386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef4f5-308c-48ad-887e-6d96ac4e123c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:20.624643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:20.625263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:20.625543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:20.625815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:20.672067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:20.694741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:20.696212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:20.815731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 151/292] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:20.821216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:20.940679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:20.957668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf2e15-5170-47cc-b080-c75397a5d767 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:20.997223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97d63-7620-4e06-aac1-75ea90cb2bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:20.997853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97d63-7620-4e06-aac1-75ea90cb2bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:20.998132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97d63-7620-4e06-aac1-75ea90cb2bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:20.998455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97d63-7620-4e06-aac1-75ea90cb2bd6 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:20.999634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea97d63-7620-4e06-aac1-75ea90cb2bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:21.001117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea97d63-7620-4e06-aac1-75ea90cb2bd6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:21.002743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 142/293] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:20 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:21.008798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:21.107179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:21.138772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50fe49-954f-4e4e-a973-40bc5f9c59ec None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:21.186980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:21.187602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:21.187881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:21.188180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:21.193346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=b495ee50aa284dc384ccc4b3b11715f4) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:21.193642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:21.195217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e884c5-f109-4486-bd56-47980fee78e2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:21.205583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 152/294] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:21 2022] GET /identity/v3/role_assignments?user.id=b495ee50aa284dc384ccc4b3b11715f4&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=dd4261a805134646858c0ad93ba486fd => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:21.944422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5f91-97bc-4845-ab5e-9f911f4225de None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:21.945398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5f91-97bc-4845-ab5e-9f911f4225de None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:21.945877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5f91-97bc-4845-ab5e-9f911f4225de None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:21.948218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 143/295] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:21.954351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c5fd-6332-4f7a-8b6a-2af3bcc9f70e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:21.954775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c5fd-6332-4f7a-8b6a-2af3bcc9f70e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:21.954955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c5fd-6332-4f7a-8b6a-2af3bcc9f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:21.981180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-aee8c5fd-6332-4f7a-8b6a-2af3bcc9f70e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:21.982688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aee8c5fd-6332-4f7a-8b6a-2af3bcc9f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:22.060037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 153/296] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:22.190883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83066-7541-4cc0-817d-06c9ec75752d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.191066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83066-7541-4cc0-817d-06c9ec75752d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.191339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83066-7541-4cc0-817d-06c9ec75752d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.192988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 144/297] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:22.198782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.199071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.199344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.217657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:22.218847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:22.251384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f7ce-4505-49bc-a984-21c14f774119 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.252021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f7ce-4505-49bc-a984-21c14f774119 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.252526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f7ce-4505-49bc-a984-21c14f774119 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.254184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 145/298] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:22.259069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.259390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.259661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.281648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:22.282817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:22.288541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:22.294981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 154/299] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:22.356723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 146/300] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:22.361275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.467148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05de38d-a4ac-44a1-9ce9-5d6c268859e8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:22.503299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:22.504386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.505081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.505627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.516587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:22.522004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:22.522925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:22.523754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:22.530196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 155/301] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:22.533096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.600185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.621223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:22.640710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936558d-6f83-4280-af2f-8ea393af21d0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:22.663900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:22.683543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:22.684879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.685168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.685439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.686139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:22.686804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:22.687847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:22.699989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 147/302] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:22.699989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.715597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7488-8f63-485f-a549-f4fe539a9cca None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:22.749534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:22.750170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.750442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.750716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.751812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:22.753276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:22.754832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 156/303] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:22.755591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.812047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d56e0-f58d-423f-a8d4-006db57236e4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:22.845905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:22.846546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.846827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.847099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.857135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:22.857966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3066a4-e0dd-4f7a-8376-decadc705160 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:22.862395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:22.863261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 148/304] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:22.864542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.869463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:22.884080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:22.892954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361647d7-fe46-4e86-b8b4-42e56d6a4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:22.893591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361647d7-fe46-4e86-b8b4-42e56d6a4cca None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.893874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361647d7-fe46-4e86-b8b4-42e56d6a4cca None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.894144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361647d7-fe46-4e86-b8b4-42e56d6a4cca None admin] PATH_INFO: `/v3/users/1566e05f05514745978c9adead251e1c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.907578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361647d7-fe46-4e86-b8b4-42e56d6a4cca None admin] RBAC: Authorizing `identity:get_user(user_id=1566e05f05514745978c9adead251e1c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:22.909057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361647d7-fe46-4e86-b8b4-42e56d6a4cca None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:22.910644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 157/305] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:22 2022] GET /identity/v3/users/1566e05f05514745978c9adead251e1c => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:22.911984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02b85-efe2-44cf-9cbc-15646d6ddda2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:22.912270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02b85-efe2-44cf-9cbc-15646d6ddda2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:22.912546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02b85-efe2-44cf-9cbc-15646d6ddda2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:22.913859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 158/306] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:22.914496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02b85-efe2-44cf-9cbc-15646d6ddda2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:22.971442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b425c-cf2d-4e68-bde3-1c2bcca04344 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.004314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.004854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.005134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.005405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] PATH_INFO: `/v3/groups` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.006057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.007486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.013169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02b85-efe2-44cf-9cbc-15646d6ddda2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.023116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 149/307] 10.222.0.27 () {60 vars in 1134 bytes} [Sat Oct 1 04:04:22 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:23.023916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:23.064525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.065145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.065421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.065687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.066359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:23.066659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.068091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1053607-df43-4dd6-8263-0b2ac0f6277e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.079450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 159/308] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:23.080900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.081256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.081600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.100891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:23.101686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:23.102860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:23.144254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dfed-ace2-49ba-9f15-32cde8410ba4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.154966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:23.182223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 160/309] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:23.188160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:23.193222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.193850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.194126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.194395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.195132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] RBAC: Adding query filter params (role.id=ba2a55ff43e847b3b060c16062a75c1e, user.id=1566e05f05514745978c9adead251e1c, scope.system=all) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:23.195441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.196987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.202452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 150/310] 10.222.0.27 () {56 vars in 1308 bytes} [Sat Oct 1 04:04:23 2022] GET /identity/v3/role_assignments?user.id=1566e05f05514745978c9adead251e1c&scope.system=all&role.id=ba2a55ff43e847b3b060c16062a75c1e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:23.309474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02320250-7834-4ff8-ac33-e6b53cb76d69 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.347886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.348571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.348853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.349124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] PATH_INFO: `/v3/users/2b53e63fae4a4c9cb02b94fb6c998837` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.350292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] RBAC: Authorizing `identity:get_user(user_id=2b53e63fae4a4c9cb02b94fb6c998837)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.351748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.354344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 161/311] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:23 2022] GET /identity/v3/users/2b53e63fae4a4c9cb02b94fb6c998837 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:23.359842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:23.465431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e522b4-9505-4b2e-bfd7-f7f9490a7625 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.468629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:23.495180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:23.505008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.505706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.505986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.506264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] PATH_INFO: `/v3/system/users/2b53e63fae4a4c9cb02b94fb6c998837/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.508026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2b53e63fae4a4c9cb02b94fb6c998837, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.509963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.522301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 151/312] 10.222.0.27 () {58 vars in 1334 bytes} [Sat Oct 1 04:04:23 2022] PUT /identity/v3/system/users/2b53e63fae4a4c9cb02b94fb6c998837/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:23.528504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:23.590666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc0cb-0d3f-421a-bcf5-cea8fe2d5583 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.635634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.636732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.637189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.637656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.650590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:23.656534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:23.657521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:23.658316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:23.660538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 162/313] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:23.667192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:23.779575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5be3c-cc06-4089-a413-bed3a247331f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.815119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.815999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.816446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.816861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.817666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:23.818134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.819645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.828561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 152/314] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:23.834986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:23.941835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37073431-6a2e-464f-87ea-ac7770eaeeff None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:23.949496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:23.978988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:23.979891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:23.980342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:23.980756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] PATH_INFO: `/v3/users/59a903609d9b4c48be535e560cd38b22` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:23.982023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=59a903609d9b4c48be535e560cd38b22)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:23.983600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:23.985658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 163/315] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:23 2022] GET /identity/v3/users/59a903609d9b4c48be535e560cd38b22 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:23.991378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:24.054431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:24.103832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a39ed6-5a50-411b-aa8a-729592aa27bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:24.141201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:24.141814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:24.142089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:24.142357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:24.212113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:24.213582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:24.268586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:24.315787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 153/316] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 04:04:24.324987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:24.430771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b35f1-55a1-483c-993e-ccfb38fbb1d1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:24.470337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61c3de-73d3-4c92-b733-79c7b7ae6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:24.471217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61c3de-73d3-4c92-b733-79c7b7ae6d46 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:24.471659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61c3de-73d3-4c92-b733-79c7b7ae6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:24.472105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61c3de-73d3-4c92-b733-79c7b7ae6d46 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:24.473410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61c3de-73d3-4c92-b733-79c7b7ae6d46 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:24.474982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61c3de-73d3-4c92-b733-79c7b7ae6d46 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:24.477076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 164/317] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:24 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:24.483582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:24.589600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e54853-40c2-4538-8d69-bfaadfb0a048 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:24.623271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:24.623873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:24.624173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:24.624441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:24.625157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] RBAC: Adding query filter params (role.id=ba2a55ff43e847b3b060c16062a75c1e, scope.project.id=76e2202316cd48b390f80fdc501b381f, user.id=59a903609d9b4c48be535e560cd38b22) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:24.625457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:24.626873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ca696-1287-4719-873f-3bcec7824b45 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:24.632955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 154/318] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:24 2022] GET /identity/v3/role_assignments?user.id=59a903609d9b4c48be535e560cd38b22&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=ba2a55ff43e847b3b060c16062a75c1e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:25.348952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1a4b0-5419-4ec5-a22b-583f02b7f595 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.349464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1a4b0-5419-4ec5-a22b-583f02b7f595 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.349539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1a4b0-5419-4ec5-a22b-583f02b7f595 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.350843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 165/319] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:25.356125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.356497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.356657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.375198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:25.376409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:25.390672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:25.418032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8468c-c309-433b-8521-aa204c5efa8c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.418323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8468c-c309-433b-8521-aa204c5efa8c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.418582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8468c-c309-433b-8521-aa204c5efa8c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.420111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 166/320] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:25.424675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36af58-edbc-4d40-b310-2820bbd9285d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.424983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36af58-edbc-4d40-b310-2820bbd9285d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.425247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36af58-edbc-4d40-b310-2820bbd9285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.442885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fd36af58-edbc-4d40-b310-2820bbd9285d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:25.444099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fd36af58-edbc-4d40-b310-2820bbd9285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:25.448369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 155/321] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:25.480573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:25.513613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 167/322] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:25.714205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:25.747726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0a33e-d0ca-41d9-80e9-0f6997b6f4fa None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.748066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0a33e-d0ca-41d9-80e9-0f6997b6f4fa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.748317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0a33e-d0ca-41d9-80e9-0f6997b6f4fa None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.750709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 168/323] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:25.756056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.756392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.756665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.776732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:25.777896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:25.817312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912aaff-72a0-4bde-87ca-b704688a4696 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:25.848820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 169/324] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:25.849662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:25.851252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:25.851884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.852197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.852462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:25.854109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:25.855547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:25.857218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 156/325] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:25.862475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:25.879900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:25.953689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb8d4f-25e3-49dc-b15d-c8f9f5b813b1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:25.955277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:25.966605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d8900-89d1-4575-a94a-33c8e0c284d0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:25.990780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:25.991353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:25.991628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:25.991895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.000491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.001095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.001371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.001639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] PATH_INFO: `/v3/groups` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.002260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.002371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:26.003677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:26.007123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:26.008014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:26.008830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 170/326] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:26.014267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.022169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 157/327] 10.222.0.27 () {60 vars in 1134 bytes} [Sat Oct 1 04:04:25 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:04:26.123034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.123224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba81b4-a778-45bf-9b36-01174eccff51 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.161585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.162203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.162478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.162746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.163414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:26.163714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.165138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.174742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 171/328] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:26.181768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.208463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:26.210614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:26.238168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5ae4-1f3b-4679-b170-8fd9c29ae8c8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.274333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.275523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.275798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.276140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.288891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:26.294298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:26.295160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:26.296136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 158/329] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:26.301176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.304507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9d4d-f410-40a0-b693-9c6169363076 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.343674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.344470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.344745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.345012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] PATH_INFO: `/v3/users/1566e05f05514745978c9adead251e1c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.346128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] RBAC: Authorizing `identity:get_user(user_id=1566e05f05514745978c9adead251e1c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.347554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.354087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 172/330] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:26 2022] GET /identity/v3/users/1566e05f05514745978c9adead251e1c => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:26.355485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.440985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e664-5157-4670-ab52-83f171665097 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.476308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:26.478768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.479779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.481504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.482137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.482816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:26.483120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.484544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.487020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:26.493778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c8fbb-5baf-4a99-899b-16a20fadb21c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.496902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 159/331] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:26.504461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.542445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.543415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.543876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.544602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] PATH_INFO: `/v3/system/users/1566e05f05514745978c9adead251e1c/roles/ba2a55ff43e847b3b060c16062a75c1e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.547177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1566e05f05514745978c9adead251e1c, role_id=ba2a55ff43e847b3b060c16062a75c1e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.548807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.563121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 173/332] 10.222.0.27 () {58 vars in 1334 bytes} [Sat Oct 1 04:04:26 2022] PUT /identity/v3/system/users/1566e05f05514745978c9adead251e1c/roles/ba2a55ff43e847b3b060c16062a75c1e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:26.640788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7346a15-c350-4740-b6a6-9033c928beea None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.682517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba2882-1f7f-43df-8bfe-4a99b0545059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.683580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba2882-1f7f-43df-8bfe-4a99b0545059 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.684083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba2882-1f7f-43df-8bfe-4a99b0545059 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.684537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba2882-1f7f-43df-8bfe-4a99b0545059 None admin] PATH_INFO: `/v3/users/2b53e63fae4a4c9cb02b94fb6c998837` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.685934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba2882-1f7f-43df-8bfe-4a99b0545059 None admin] RBAC: Authorizing `identity:get_user(user_id=2b53e63fae4a4c9cb02b94fb6c998837)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.687672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba2882-1f7f-43df-8bfe-4a99b0545059 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.689984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 160/333] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:26 2022] GET /identity/v3/users/2b53e63fae4a4c9cb02b94fb6c998837 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:26.697116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:26.817388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb18a7-daee-474c-ad10-75cfe593c11f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:26.861705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:26.862705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:26.863208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:26.863678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:26.864643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] RBAC: Adding query filter params (role.id=dd4261a805134646858c0ad93ba486fd, user.id=2b53e63fae4a4c9cb02b94fb6c998837, scope.system=all) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:26.865185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:26.866899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6fae-24af-47ab-95d1-bc43420c38d2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:26.881784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 174/334] 10.222.0.27 () {56 vars in 1308 bytes} [Sat Oct 1 04:04:26 2022] GET /identity/v3/role_assignments?user.id=2b53e63fae4a4c9cb02b94fb6c998837&scope.system=all&role.id=dd4261a805134646858c0ad93ba486fd => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:28.421635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ab79-3a81-42a2-b52b-e2bc04d5b9d2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:28.422133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ab79-3a81-42a2-b52b-e2bc04d5b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:28.422234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ab79-3a81-42a2-b52b-e2bc04d5b9d2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:28.423816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 161/335] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:28.429412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c69ed-e3d0-4b51-ac31-a7fa06857987 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:28.429814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c69ed-e3d0-4b51-ac31-a7fa06857987 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:28.429978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c69ed-e3d0-4b51-ac31-a7fa06857987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:28.450167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6c7c69ed-e3d0-4b51-ac31-a7fa06857987 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:28.451355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6c7c69ed-e3d0-4b51-ac31-a7fa06857987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:28.461724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:28.532024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 175/336] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:28.819129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ab79-3a81-42a2-b52b-e2bc04d5b9d2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:28.904914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2f94-8c64-43a0-b0f5-c32fabed9783 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:28.905217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2f94-8c64-43a0-b0f5-c32fabed9783 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:28.905460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2f94-8c64-43a0-b0f5-c32fabed9783 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:28.907036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 176/337] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:28.913042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:28.924538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:28.924970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:28.925243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:28.957914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:28.959243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:28.989560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ab79-3a81-42a2-b52b-e2bc04d5b9d2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:29.073314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:29.074238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:29.074458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 177/338] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:29.074898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:29.075432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:29.096901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:29.101988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:29.102970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:29.103820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:29.110512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 162/339] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:29.112078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:29.239858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:29.270974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ebb0-65e3-4b75-81a6-cffc09dfb8e4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:29.316378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:29.316992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:29.317271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:29.317540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:29.318210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:29.318506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:29.319866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:29.328719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 178/340] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:29.334523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:29.498816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142faeb-7289-4b1c-b33d-719d3db8d678 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:29.533146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:29.544103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675b406-1378-41dd-8ef3-b4af9a4fa1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:29.545083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675b406-1378-41dd-8ef3-b4af9a4fa1be None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:29.545555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675b406-1378-41dd-8ef3-b4af9a4fa1be None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:29.546041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675b406-1378-41dd-8ef3-b4af9a4fa1be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:29.628418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675b406-1378-41dd-8ef3-b4af9a4fa1be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:29.630203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675b406-1378-41dd-8ef3-b4af9a4fa1be None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:29.662724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:29.789711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 163/341] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:29.791112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b12e-c43e-4f23-9625-03160f87ea67 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:29.791482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b12e-c43e-4f23-9625-03160f87ea67 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:29.791725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b12e-c43e-4f23-9625-03160f87ea67 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:29.793262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 164/342] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:29.796700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b12e-c43e-4f23-9625-03160f87ea67 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:29.822045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404c894-6b6a-4feb-9f5a-b8b032b2525f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:29.852692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:29.867223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718ce67-d54e-479d-9201-a614ab744520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:29.867875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ce67-d54e-479d-9201-a614ab744520 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:29.869069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ce67-d54e-479d-9201-a614ab744520 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:29.869348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718ce67-d54e-479d-9201-a614ab744520 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:29.878665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:29.888524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718ce67-d54e-479d-9201-a614ab744520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e718ce67-d54e-479d-9201-a614ab744520 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:29.893473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:29.894528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:29.895723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:29.897430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 179/343] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:29.901813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ef45-860e-41ea-9275-6ee8c939b892 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:29.902094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ef45-860e-41ea-9275-6ee8c939b892 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:29.902783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7ef45-860e-41ea-9275-6ee8c939b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:29.927214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a5e7ef45-860e-41ea-9275-6ee8c939b892 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:29.928420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a5e7ef45-860e-41ea-9275-6ee8c939b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:29.964390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b12e-c43e-4f23-9625-03160f87ea67 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.011710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.013041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.013744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.014219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.016163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:30.017932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:30.019223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 180/344] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:30.020680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 165/345] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:29 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:30.020855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4762-88f4-4d92-a981-9eb84961aed4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.021229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4762-88f4-4d92-a981-9eb84961aed4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.021572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4762-88f4-4d92-a981-9eb84961aed4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.022146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.023158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 181/346] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:30.027212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4762-88f4-4d92-a981-9eb84961aed4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.125067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:30.134808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cc58-65ad-4ded-b172-34c59dc2b1fd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.139466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4762-88f4-4d92-a981-9eb84961aed4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.167365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:30.177049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc68399-c049-4d80-91c5-94c013e8777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.178154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68399-c049-4d80-91c5-94c013e8777f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.179055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68399-c049-4d80-91c5-94c013e8777f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.179603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68399-c049-4d80-91c5-94c013e8777f None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.185579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.186199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.186474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.186748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.187424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:30.187727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:30.188773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc68399-c049-4d80-91c5-94c013e8777f None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:30.189100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:30.190642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc68399-c049-4d80-91c5-94c013e8777f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:30.197081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 182/347] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:30.197991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 166/348] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:30.198848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.200320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.200931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.203616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.220358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:30.221870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:30.300513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 183/349] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:30.301824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.331729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc71e3b-037b-4c51-9bc4-f0ae445fcb23 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.365533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.366141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.366417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.366682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.395424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:30.420660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf87b2f-4f79-4238-b447-802247181b7e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.445594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:30.457032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:30.458509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:30.459331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.459973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.460365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.460733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.461612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=36d03b6452324c61890a85691e4e0163) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:30.462605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:30.464451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:30.470726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 184/350] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=dd4261a805134646858c0ad93ba486fd => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:30.607853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 167/351] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 01 04:04:30.613429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.637530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.716614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:30.789557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90576781-4eed-40f8-897a-38d8391ea906 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.792970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4656-e451-4baf-afac-2fa02b0ab91b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.839153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.839522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049482b-51d4-45b2-b6a1-22300cadec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:30.839818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.840186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049482b-51d4-45b2-b6a1-22300cadec75 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.840310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.840473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049482b-51d4-45b2-b6a1-22300cadec75 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.840572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.840723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049482b-51d4-45b2-b6a1-22300cadec75 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.841878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049482b-51d4-45b2-b6a1-22300cadec75 None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:30.843327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049482b-51d4-45b2-b6a1-22300cadec75 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:30.846153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 185/352] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:30.847552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41bcc-a6ec-4f8e-bd5e-2560ddd81088 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:30.847833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41bcc-a6ec-4f8e-bd5e-2560ddd81088 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:30.848150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd41bcc-a6ec-4f8e-bd5e-2560ddd81088 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:30.853894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 186/353] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:30.855065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41bcc-a6ec-4f8e-bd5e-2560ddd81088 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.858888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:30.864114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:30.865097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:30.865934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 168/354] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:30.866656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:30.919345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:30.984304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd41bcc-a6ec-4f8e-bd5e-2560ddd81088 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:30.999625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60683d98-1c9c-44cd-b524-8b3aa633c2eb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.022032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:31.024348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff67bf0-a8ae-4487-b519-60c1dfef97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.025437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67bf0-a8ae-4487-b519-60c1dfef97b7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.025718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67bf0-a8ae-4487-b519-60c1dfef97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.025988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67bf0-a8ae-4487-b519-60c1dfef97b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.036946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff67bf0-a8ae-4487-b519-60c1dfef97b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6ff67bf0-a8ae-4487-b519-60c1dfef97b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:31.042930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:31.045042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:31.046929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 187/355] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:31.048520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.048694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.048848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.048994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.049141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.049289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.049433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.055957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:31.055957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:31.055957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 169/356] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:30 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:31.057578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.069301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:31.070687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:31.160079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 188/357] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:31.162046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.234244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae61538-3f7c-4e15-ba82-c15532a705e4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.236407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:31.283605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.284391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.284675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.285015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.285686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:31.285989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:31.287555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:31.297118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f7c82-5592-4377-a33e-27ac3c05eb61 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.312073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 170/358] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:31.313076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.382221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.384437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.384725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.384995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.385733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=36d03b6452324c61890a85691e4e0163) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:31.386039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:31.387472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:31.398342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 189/359] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:31.399264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.404303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:31.531902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3e20-d2d6-4800-b5cf-3e1249769949 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.583555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.584221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.584502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.584776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.585456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:31.585762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:31.587755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:31.593866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aa5f3-3098-4f6a-810d-4c4c1a81facd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.597884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 171/360] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:31.598758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.603199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:31.640789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9514a3-6442-4457-aab6-70340b0f29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.641419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9514a3-6442-4457-aab6-70340b0f29f3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.641698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9514a3-6442-4457-aab6-70340b0f29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.641979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9514a3-6442-4457-aab6-70340b0f29f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.728020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9514a3-6442-4457-aab6-70340b0f29f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:31.729580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9514a3-6442-4457-aab6-70340b0f29f3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:31.737319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4a65b-6988-41f7-a213-bdaecf21977b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.751926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:31.787692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d691569-9c56-484b-896d-cdc0e341b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.788454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691569-9c56-484b-896d-cdc0e341b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.788837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691569-9c56-484b-896d-cdc0e341b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.789204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d691569-9c56-484b-896d-cdc0e341b0f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.803539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d691569-9c56-484b-896d-cdc0e341b0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6d691569-9c56-484b-896d-cdc0e341b0f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:31.808940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:31.809988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:31.810780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:31.813025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 172/361] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:31.814457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65393e1-26c2-450a-8af7-5a59003f08a3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.814945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65393e1-26c2-450a-8af7-5a59003f08a3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.815409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65393e1-26c2-450a-8af7-5a59003f08a3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.816868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 173/362] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:31.817785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65393e1-26c2-450a-8af7-5a59003f08a3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.855614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 190/363] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:31.856691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.856974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.857296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:31.871619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:31.879945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:31.881444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:31.948045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65393e1-26c2-450a-8af7-5a59003f08a3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:31.963994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 191/364] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:31.965050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:31.997230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:31.998290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:31.998817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:31.999284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] PATH_INFO: `/v3/users/1566e05f05514745978c9adead251e1c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.001592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] RBAC: Authorizing `identity:get_user(user_id=1566e05f05514745978c9adead251e1c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.003333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.009659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 174/365] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/users/1566e05f05514745978c9adead251e1c => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.010727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.077455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de0cb-10c4-4cc6-a053-51ce34d6d8fc None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.079527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.117066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.118485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.118908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.119321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.120711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:32.121171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.122815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.131406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 192/366] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.131903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.135110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.245173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a7b1b-6dd6-43d4-aa6a-71fef5473298 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.250940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafc8c4-f984-4c78-a498-78188478273d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.285051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.286050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.286538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.286995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.288003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] RBAC: Adding query filter params (role.id=ba2a55ff43e847b3b060c16062a75c1e, user.id=1566e05f05514745978c9adead251e1c, scope.system=all) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:32.288516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.290297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.303404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 193/367] 10.222.0.27 () {56 vars in 1308 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/role_assignments?user.id=1566e05f05514745978c9adead251e1c&scope.system=all&role.id=ba2a55ff43e847b3b060c16062a75c1e => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.304756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.319982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.319982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.319982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.319982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.320382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.320813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.323465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 175/368] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.329104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.404443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.439227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc7acd-8e3b-4eee-9a01-6da8ceb504d6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.481169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.481812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.482090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.482360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.507066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463e8d-ad67-4c45-8222-a07364aaa659 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.513981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.554276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.555008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.555197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.555541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.556834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.558293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.559877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 176/369] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.560914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.563394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.565266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.654870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.671533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950a9c-e479-49ae-b8c5-70b4ed509d2d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.681996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 194/370] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:32.683279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.715802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.716477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.716755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.717023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.729069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:32.734027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:32.734933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 177/371] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:32.735894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.773203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.810655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0230f3-0c3d-4cad-ae8e-d3b455aef8c6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.854047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.855100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.855581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.856069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.859009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=76e2202316cd48b390f80fdc501b381f) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:32.859719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.860882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3d73c-542e-432e-9e6e-1f9e6c8fa1e6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:32.862631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.869592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 195/372] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=dd4261a805134646858c0ad93ba486fd => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.870795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:32.902377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:32.903103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:32.903384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:32.903659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:32.904929 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:32.906315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:32.912274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 178/373] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:32.913328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:32.913560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:33.001775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80259-778e-45b9-b272-eb235b72287b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.034847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:33.038163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4811afc-85a7-4102-b4e5-3e7827780c9f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.050646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.052093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.052660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.053132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.054089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:33.054567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.056813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:33.068369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 196/374] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:33.077145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:33.078403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.079124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.079484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.079815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.081194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.082770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:33.084662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 179/375] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:32 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:33.091894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:33.182865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:33.203787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfa87-ebd5-4eda-b58f-3b7563d78be2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.243504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.244187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.244466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.244735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.245160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3785f1-580c-40d9-9058-a0502688d16c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.287584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.288553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.289028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.289478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.291199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=76e2202316cd48b390f80fdc501b381f) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:33.291690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.293519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:33.301642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 180/376] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:33 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:33.345383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.347150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:33.436946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:33.457757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 197/377] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:33.464751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:33.504469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:33.598992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7678-be5c-4f3c-a7c4-a263b2c74d9a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.643279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508da35-9559-483e-8247-466591e29e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.643951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508da35-9559-483e-8247-466591e29e43 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.644242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508da35-9559-483e-8247-466591e29e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.644770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508da35-9559-483e-8247-466591e29e43 None admin] PATH_INFO: `/v3/projects/05869adb61214f878dfb2cd13c841b78` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.646010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508da35-9559-483e-8247-466591e29e43 None admin] RBAC: Authorizing `identity:get_project(project_id=05869adb61214f878dfb2cd13c841b78)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.647478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508da35-9559-483e-8247-466591e29e43 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:33.649549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 181/378] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:33 2022] GET /identity/v3/projects/05869adb61214f878dfb2cd13c841b78 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:33.654995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:33.760516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994334f-c34e-485e-bd87-ad605949eec5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.797104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.797750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.798025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.798297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] PATH_INFO: `/v3/groups/10864a25607a46a8a499c22291af4e19` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.809485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] RBAC: Authorizing `identity:get_group(group_id=10864a25607a46a8a499c22291af4e19)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.811655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19aaf4-59b6-4cb8-b436-cd11fe4f984d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.812114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19aaf4-59b6-4cb8-b436-cd11fe4f984d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.812274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19aaf4-59b6-4cb8-b436-cd11fe4f984d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.813711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 182/379] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:33.814561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:33.816532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 198/380] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:33 2022] GET /identity/v3/groups/10864a25607a46a8a499c22291af4e19 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:33.818584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646a7f6-a89c-4107-864b-cc17aa6e0f0e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.818931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646a7f6-a89c-4107-864b-cc17aa6e0f0e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.819275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646a7f6-a89c-4107-864b-cc17aa6e0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.829500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:33.855907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f646a7f6-a89c-4107-864b-cc17aa6e0f0e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:33.857262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f646a7f6-a89c-4107-864b-cc17aa6e0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:33.886106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:33.952807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20120fc-b564-4755-9d39-87871a19ccc0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:33.990112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:33.991522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:33.992035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:33.992623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:33.993718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] RBAC: Adding query filter params (group.id=10864a25607a46a8a499c22291af4e19, role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=05869adb61214f878dfb2cd13c841b78) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:33.994215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:33.996064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd63c7-b0da-47d1-8092-e02d86f67643 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:34.002496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 199/381] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:33 2022] GET /identity/v3/role_assignments?group.id=10864a25607a46a8a499c22291af4e19&scope.project.id=05869adb61214f878dfb2cd13c841b78&role.id=8fdee6d92c844466842df5998d45def4 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:34.005153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 183/382] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:34.276423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0336bbe-e449-49e8-a393-287e4f6f2389 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:34.277092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0336bbe-e449-49e8-a393-287e4f6f2389 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:34.277611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0336bbe-e449-49e8-a393-287e4f6f2389 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:34.279513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 200/383] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:34.285145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:34.285647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:34.286142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:34.305737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:34.307318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:34.333191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:34.382770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 184/384] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:34.399967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0336bbe-e449-49e8-a393-287e4f6f2389 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:34.563044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0336bbe-e449-49e8-a393-287e4f6f2389 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:34.578649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:34.608674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:34.609310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:34.609587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:34.609856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:34.628803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:34.633725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:34.634617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:34.635466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 201/385] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:34.641384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:34.732058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:34.877603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c911f-fa5f-4897-85d0-d7d63e8bae8a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:34.877811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17105-8bfe-49d1-a792-28c6c53b1885 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:34.914012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:34.914682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:34.914961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:34.915231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:34.925814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:34.931505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:34.932436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:34.933226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 202/386] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:34.939118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:34.939977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:34.940825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:34.941296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:34.941756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:34.942637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:34.943133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:34.944751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:34.955309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 185/387] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:34.960411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:34.981737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:35.004807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:35.059981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06acf4-e082-4979-824e-bec31ceacc1c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.096951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.097501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.097782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.098062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.098733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:35.099038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.100456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.109998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 203/388] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:35.115460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:35.139262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e61a8f-dc8f-4a9c-8b8d-f70650d8fb50 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.203022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.203720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.204033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.204307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.208642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.210098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.212517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 186/389] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:34 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:35.217227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:35.217663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:35.227975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc4940-92f9-4627-9e36-18b423ebf4e8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.263627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.264322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.264611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.264875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.266016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.267446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.269350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 204/390] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:35 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:35.275559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:35.384967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3af6-0d73-467a-bbf0-0bfa0beb3d28 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.408347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:35.423229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.423876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.424180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.424453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.425595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.427044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.429001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 205/391] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:35 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:35.430320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226589cf-938a-4414-be5c-fc02f0a89054 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.434626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:35.467056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:35.494232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.494888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.495168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.495441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.496910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.498354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.500008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 187/392] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:35 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:35.505894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:35.550358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b14dc0-20ac-488a-ba41-89a0848ae59f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.587787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06030d-2f24-4dd3-85d4-53d8ba291280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.588728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06030d-2f24-4dd3-85d4-53d8ba291280 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.589161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06030d-2f24-4dd3-85d4-53d8ba291280 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.590772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06030d-2f24-4dd3-85d4-53d8ba291280 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163/groups/911076f67eb7478bb39ce2b751a3b01a/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.593176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06030d-2f24-4dd3-85d4-53d8ba291280 None admin] RBAC: Authorizing `identity:create_grant(project_id=36d03b6452324c61890a85691e4e0163, group_id=911076f67eb7478bb39ce2b751a3b01a, role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.594775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06030d-2f24-4dd3-85d4-53d8ba291280 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.610469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 206/393] 10.222.0.27 () {58 vars in 1442 bytes} [Sat Oct 1 04:04:35 2022] PUT /identity/v3/projects/36d03b6452324c61890a85691e4e0163/groups/911076f67eb7478bb39ce2b751a3b01a/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:04:35.659449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e7b34-7af7-48e9-a6e5-658f0e229401 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.659795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e7b34-7af7-48e9-a6e5-658f0e229401 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.660223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e7b34-7af7-48e9-a6e5-658f0e229401 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.661960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 207/394] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:35.668046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.668433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.668809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.688597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:35.690074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:35.706604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a8ff7-f7ff-4f5d-af4f-04158b5994bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:35.781046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:35.782966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:35.784884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:35.785337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163/groups/911076f67eb7478bb39ce2b751a3b01a/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:35.792071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] RBAC: Authorizing `identity:create_grant(project_id=36d03b6452324c61890a85691e4e0163, group_id=911076f67eb7478bb39ce2b751a3b01a, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:35.793818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:35.807220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 208/395] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:35.820043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 188/396] 10.222.0.27 () {58 vars in 1442 bytes} [Sat Oct 1 04:04:35 2022] PUT /identity/v3/projects/36d03b6452324c61890a85691e4e0163/groups/911076f67eb7478bb39ce2b751a3b01a/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:36.110453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:36.131018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:36.219678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc49f-b8fa-44b0-b792-8b758ad5b1f0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:36.255599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:36.256675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:36.256956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:36.257225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:36.268135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:36.273365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:36.274595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:36.275606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:36.278128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 209/397] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:36.283961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:36.307044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:36.416522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a176-aac8-4391-a47e-43ca84449381 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:36.463089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:36.463714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:36.464015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:36.464289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:36.464964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:36.465266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:36.466635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261892d0-9a78-4307-9d6d-8892ddaa8a50 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:36.480167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 189/398] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:36.485983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:36.494924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd506-5101-4f71-b855-b36e51812b12 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:36.495235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd506-5101-4f71-b855-b36e51812b12 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:36.495489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd506-5101-4f71-b855-b36e51812b12 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:36.497396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 190/399] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:36.504659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:36.504935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:36.505204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:36.537947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:36.539135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:36.632900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:36.675011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4d49-5eda-4df1-9c85-d54aebd03735 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:36.701753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 191/400] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:36.714849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:36.715493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:36.715770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:36.716072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:36.717248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:36.718824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:36.720776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 210/401] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:36 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:36.726395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:36.740329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:36.833856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e750ea-2ffa-46c4-93d6-0727232b5808 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:36.869261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:36.869901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:36.870177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:36.870450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:36.871576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:36.873106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:36.874736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 192/402] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:36 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:36.880640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:36.990421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d01d29-89c2-46f0-b043-cd3907cb612a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:37.029402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:37.030157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.030492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.030827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f/groups/911076f67eb7478bb39ce2b751a3b01a/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.032911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] RBAC: Authorizing `identity:create_grant(project_id=76e2202316cd48b390f80fdc501b381f, group_id=911076f67eb7478bb39ce2b751a3b01a, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:37.034501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:37.050151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:37.053048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 211/403] 10.222.0.27 () {58 vars in 1442 bytes} [Sat Oct 1 04:04:36 2022] PUT /identity/v3/projects/76e2202316cd48b390f80fdc501b381f/groups/911076f67eb7478bb39ce2b751a3b01a/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:37.160480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:37.190552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ac36-55e1-42ca-8561-d8261f9a0d14 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:37.237850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294ffd-f1a5-4896-8078-cbc1dbeed8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:37.238962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294ffd-f1a5-4896-8078-cbc1dbeed8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.239433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294ffd-f1a5-4896-8078-cbc1dbeed8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.239893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294ffd-f1a5-4896-8078-cbc1dbeed8a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.254396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af294ffd-f1a5-4896-8078-cbc1dbeed8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-af294ffd-f1a5-4896-8078-cbc1dbeed8a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:37.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:37.260673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:37.261460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:37.268033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 193/404] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:37.270760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:37.287715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:37.400849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2e75-8ca9-4f3b-8015-e927d0d27e5c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.401382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2e75-8ca9-4f3b-8015-e927d0d27e5c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.401382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a2e75-8ca9-4f3b-8015-e927d0d27e5c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.403538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 194/405] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:37.409836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071674cb-6be4-41e0-95be-007092863d8b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.410115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071674cb-6be4-41e0-95be-007092863d8b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.410388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071674cb-6be4-41e0-95be-007092863d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.416464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f107c4a-203a-4808-875e-25ccbf1e9e81 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:37.452982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-071674cb-6be4-41e0-95be-007092863d8b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:37.454195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-071674cb-6be4-41e0-95be-007092863d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:37.460653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:37.462206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.462685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.463180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.464649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:37.465150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:37.466734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:37.483095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 212/406] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:37.484852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:37.599310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 195/407] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:37.606136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:37.642515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713cd5-7115-4f0b-b41a-53a607ebd3bf None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:37.681543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:37.682567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.683053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.683532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.684867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:37.686469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:37.688301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 213/408] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:37 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:37.694128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071674cb-6be4-41e0-95be-007092863d8b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:37.779651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:37.826657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071674cb-6be4-41e0-95be-007092863d8b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:37.875131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:37.875722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:37.876028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:37.876301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:37.877439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:37.878879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:37.881829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 196/409] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:37 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:37.887141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:38.000860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626f85-2cf4-40b9-83c3-87ef1ec99989 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:38.043467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:38.044171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.044453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.044731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f/groups/911076f67eb7478bb39ce2b751a3b01a/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.049739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] RBAC: Authorizing `identity:create_grant(project_id=76e2202316cd48b390f80fdc501b381f, group_id=911076f67eb7478bb39ce2b751a3b01a, role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:38.051180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:38.056183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:38.075722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 214/410] 10.222.0.27 () {58 vars in 1442 bytes} [Sat Oct 1 04:04:37 2022] PUT /identity/v3/projects/76e2202316cd48b390f80fdc501b381f/groups/911076f67eb7478bb39ce2b751a3b01a/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:38.179674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:38.323527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656fc6-437e-438d-bb82-ccec55bbbcbc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:38.372694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:38.373705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.374204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.374669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.378352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:38.390634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:38.396125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:38.397153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:38.398372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 197/411] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:38.406864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:38.550881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5a132-f6d5-4ced-bd49-8699408f181e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:38.596949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:38.597918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.598391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.598876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.599748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:38.600260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:38.602346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7351ec8-20c1-47b0-973a-a0f8a1cc1c68 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:38.613824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 215/412] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:38.619549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:38.660751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f38eb-d726-49aa-9fec-7f3d6dd9dd3f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.661374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f38eb-d726-49aa-9fec-7f3d6dd9dd3f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.661844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f38eb-d726-49aa-9fec-7f3d6dd9dd3f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.663647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 216/413] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:04:38.669032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19d03-e23c-499c-b38e-48090fdb8d8c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.669318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19d03-e23c-499c-b38e-48090fdb8d8c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.669633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19d03-e23c-499c-b38e-48090fdb8d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.694418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-20d19d03-e23c-499c-b38e-48090fdb8d8c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:38.697522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-20d19d03-e23c-499c-b38e-48090fdb8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:38.766437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bd6af-c588-4961-8bc3-4c46bb09f00b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:38.767064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:38.786883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 217/414] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:38.788391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83db1-c112-47c4-b92c-2e83acd99718 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.788676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83db1-c112-47c4-b92c-2e83acd99718 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.789046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83db1-c112-47c4-b92c-2e83acd99718 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.790586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 218/415] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:38.796035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.796540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.797005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.804325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:38.805448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:38.805793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:38.806071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] PATH_INFO: `/v3/groups/10864a25607a46a8a499c22291af4e19` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:38.807973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] RBAC: Authorizing `identity:get_group(group_id=10864a25607a46a8a499c22291af4e19)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:38.808864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:38.810976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 198/416] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:38 2022] GET /identity/v3/groups/10864a25607a46a8a499c22291af4e19 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:38.816884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:38.832674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:38.833884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:38.934091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:38.951210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 219/417] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:39.004657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6609d-8a58-4deb-9bc8-ddc4a77cb80c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.057844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.058832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.059304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.059767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] PATH_INFO: `/v3/projects/05869adb61214f878dfb2cd13c841b78` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.061140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] RBAC: Authorizing `identity:get_project(project_id=05869adb61214f878dfb2cd13c841b78)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:39.062756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:39.064626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 199/418] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:38 2022] GET /identity/v3/projects/05869adb61214f878dfb2cd13c841b78 => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:39.070261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.211010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3a84-d922-4aaa-a9e1-669b3efeca67 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.241023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:39.248989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.263800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.264511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.264792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.265067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] PATH_INFO: `/v3/projects/05869adb61214f878dfb2cd13c841b78/groups/10864a25607a46a8a499c22291af4e19/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.266968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] RBAC: Authorizing `identity:create_grant(project_id=05869adb61214f878dfb2cd13c841b78, group_id=10864a25607a46a8a499c22291af4e19, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:39.268444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:39.287113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 220/419] 10.222.0.27 () {58 vars in 1442 bytes} [Sat Oct 1 04:04:39 2022] PUT /identity/v3/projects/05869adb61214f878dfb2cd13c841b78/groups/10864a25607a46a8a499c22291af4e19/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:04:39.287113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.400740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317dfa6-4247-4d3a-a032-43f5b304a144 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.440830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.442267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.442742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.443233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.447084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212e38-b52b-464b-bbe9-08ca7ad62e58 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.455547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:39.461535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:39.462486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:39.463281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:39.466038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 221/420] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:39.471867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.515252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:39.528742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.529415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.529692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.529963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.540341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:39.552616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:39.558432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:39.559370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:39.560208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 200/421] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:39.567913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.626091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01ede8-70cd-43e1-bd06-38b396b88c07 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.693690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.695530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.700578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.701132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.702071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:39.702574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:39.705397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:39.720269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 222/422] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:39.725647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1cd7-e588-45ce-8be4-8358185898f6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.727275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.799358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.800360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.800837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.801304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.802417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:39.809977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:39.811617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:39.832022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 201/423] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:39.838240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:39.905036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:39.908433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162ac4b-f0e7-4ea4-b011-a15cec763ee4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:39.921745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:39.946099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41460933-715c-4945-bed6-0a4d36c0c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:39.947040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460933-715c-4945-bed6-0a4d36c0c8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:39.947532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460933-715c-4945-bed6-0a4d36c0c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:39.948021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460933-715c-4945-bed6-0a4d36c0c8e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:39.986607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9127e-d537-459f-aa45-790afe395687 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.022106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41460933-715c-4945-bed6-0a4d36c0c8e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.025128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41460933-715c-4945-bed6-0a4d36c0c8e4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.032258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aefcf5-578d-4c58-a5a0-65e1a7405485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.032878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aefcf5-578d-4c58-a5a0-65e1a7405485 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.033157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aefcf5-578d-4c58-a5a0-65e1a7405485 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.033430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aefcf5-578d-4c58-a5a0-65e1a7405485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.106867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aefcf5-578d-4c58-a5a0-65e1a7405485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.108909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aefcf5-578d-4c58-a5a0-65e1a7405485 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.160406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:40.168076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 223/424] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:40.169602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595ebc-cd20-4182-8a8f-9b6f6ce67a46 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.170085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595ebc-cd20-4182-8a8f-9b6f6ce67a46 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.170554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59595ebc-cd20-4182-8a8f-9b6f6ce67a46 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.172120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:40.173117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 224/425] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:40.175957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59595ebc-cd20-4182-8a8f-9b6f6ce67a46 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.230508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 202/426] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:40.230508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.230508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.230508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.246668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:40.247967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:40.320276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59595ebc-cd20-4182-8a8f-9b6f6ce67a46 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.328212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 203/427] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:40.329183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.361238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.362291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.362815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.363352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.365671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.367991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.370536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 225/428] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:40.376586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.486477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:40.506669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:40.541519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d69a7-5c14-45ef-89ce-5b1e1f50cde6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.558455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e787a9-8a2c-415d-b6ad-dc1247871dde None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.609637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf04f8a-7da4-467a-8ec1-5eadc1da6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.610840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04f8a-7da4-467a-8ec1-5eadc1da6a5b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.611129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04f8a-7da4-467a-8ec1-5eadc1da6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.611496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04f8a-7da4-467a-8ec1-5eadc1da6a5b None admin] PATH_INFO: `/v3/projects/36d03b6452324c61890a85691e4e0163` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.612889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf04f8a-7da4-467a-8ec1-5eadc1da6a5b None admin] RBAC: Authorizing `identity:get_project(project_id=36d03b6452324c61890a85691e4e0163)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.614445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2a76-3fec-4ffd-a824-deff6229bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.614676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf04f8a-7da4-467a-8ec1-5eadc1da6a5b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.615080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2a76-3fec-4ffd-a824-deff6229bb29 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.615356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2a76-3fec-4ffd-a824-deff6229bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.615628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2a76-3fec-4ffd-a824-deff6229bb29 None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.616345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 204/429] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/projects/36d03b6452324c61890a85691e4e0163 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:40.617064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e2a76-3fec-4ffd-a824-deff6229bb29 None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.618207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f5a5-c9ca-4214-8477-0ed99842c709 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.618539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f5a5-c9ca-4214-8477-0ed99842c709 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.618813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388f5a5-c9ca-4214-8477-0ed99842c709 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.619034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e2a76-3fec-4ffd-a824-deff6229bb29 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.620254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 205/430] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:40.623403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f5a5-c9ca-4214-8477-0ed99842c709 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.624493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 226/431] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:40.625662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.625947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.626224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.651669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:40.653095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:40.728104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 227/432] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:40.728323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.736854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388f5a5-c9ca-4214-8477-0ed99842c709 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.773077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.774186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.774624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.774896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.776075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.777564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.779515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 206/433] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:40.780406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.803604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:40.816356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:40.860745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12182-16fa-476d-9c10-b48431ce385a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.898836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405c905-33f1-4821-b017-cffe24f57c4c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:40.903107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.903878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.904334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.904755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.905606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=36d03b6452324c61890a85691e4e0163) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:40.906049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:40.908059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:40.916083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 228/434] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=dd4261a805134646858c0ad93ba486fd => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:40.917315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:40.938443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:40.939313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:40.939700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:40.940161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:40.955127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:40.963251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:40.964242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:40.965378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 207/435] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:40.973013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.076178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.098178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2c2e3-3b88-4c6a-8037-176372769b17 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.100482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2da5c-425f-4ba5-9018-3bfa85804c7b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.132365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.136946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.137848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.138387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.138942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.139746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:41.140320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.140648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.141253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.142214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.142326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.142531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.143268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=36d03b6452324c61890a85691e4e0163) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:41.143578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.145503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.152989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 229/436] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=36d03b6452324c61890a85691e4e0163&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:41.153614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.154402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 208/437] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:41.161916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.288249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e26a04-c8fa-46cf-a559-e9ebf0947973 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.301153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f3754-0d4e-499a-a419-3c26db49ea93 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.339741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.341010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.341366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.341804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.348637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.349559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.350014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.350590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.355962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:41.362272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:41.363242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:41.364377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 230/438] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:41.370900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.373048 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.449304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.451483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.453453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.514132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bbb70-4fd5-4f5d-a747-4bdbdb2e4810 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.560558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.561524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.561999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.562479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.563351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:41.563860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.565520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.574780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 231/439] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:41.581023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 209/440] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:41.581923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.587715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.648282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.712325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526681c-f1b5-471a-b94f-3e7d5685affd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.721099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab450d-d94c-412f-8ef7-f6497e3895da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.734451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.758172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.758782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.759068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.759333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.763375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c2c56-1eca-4318-881b-68e65c4249a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.763375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c2c56-1eca-4318-881b-68e65c4249a4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.763926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c2c56-1eca-4318-881b-68e65c4249a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.763926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c2c56-1eca-4318-881b-68e65c4249a4 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.765091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c2c56-1eca-4318-881b-68e65c4249a4 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.766538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c2c56-1eca-4318-881b-68e65c4249a4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.768185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 210/441] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:41.769927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ca93-4cec-4d00-9687-fb6041b322c0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.769927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ca93-4cec-4d00-9687-fb6041b322c0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.770110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ca93-4cec-4d00-9687-fb6041b322c0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.771400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 211/442] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:41.778734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71ca93-4cec-4d00-9687-fb6041b322c0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.843077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.844580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.886969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71ca93-4cec-4d00-9687-fb6041b322c0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:41.897525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:41.920552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52545c-f7d3-41db-8f2f-96548143bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:41.921113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52545c-f7d3-41db-8f2f-96548143bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.921389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52545c-f7d3-41db-8f2f-96548143bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.921658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52545c-f7d3-41db-8f2f-96548143bf23 None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.923099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52545c-f7d3-41db-8f2f-96548143bf23 None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:41.924589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52545c-f7d3-41db-8f2f-96548143bf23 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:41.926152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 212/443] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:41.927245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:41.927521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:41.927789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:41.943823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 232/444] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:41.944689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:41.946448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:41.947905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:41.964444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:42.013986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 213/445] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:42.014818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:42.050669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf156d-e00f-4508-b553-e76126eb1be9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.088698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.089300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.089580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.089854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.091000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=dd4261a805134646858c0ad93ba486fd, scope.project.id=76e2202316cd48b390f80fdc501b381f) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:42.091311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:42.093127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:42.099734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 233/446] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:41 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=dd4261a805134646858c0ad93ba486fd => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:42.116206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297dc1-3f1f-4ab7-8bf3-f4f7ea7000ed None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.128128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:42.155847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.156568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.156831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.157100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] PATH_INFO: `/v3/projects/76e2202316cd48b390f80fdc501b381f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.158354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] RBAC: Authorizing `identity:get_project(project_id=76e2202316cd48b390f80fdc501b381f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:42.159843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:42.161787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 214/447] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/projects/76e2202316cd48b390f80fdc501b381f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:42.167836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:42.255794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:42.278239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8938730-f575-47b7-bab5-9cec1aab12a3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.280039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:42.313164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.313799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.314083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.314355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] PATH_INFO: `/v3/groups/911076f67eb7478bb39ce2b751a3b01a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.315551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] RBAC: Authorizing `identity:get_group(group_id=911076f67eb7478bb39ce2b751a3b01a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:42.317066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:42.318672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 234/448] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/groups/911076f67eb7478bb39ce2b751a3b01a => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:42.325150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:42.395659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af148c12-98a5-4529-9b1d-e7a57126c344 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.440361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.441526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.442042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.442313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.453758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:42.454003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aa984-2600-46aa-aafd-3966be7dce3a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:42.458687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:42.459574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:04:42.460553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:42.465012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 215/449] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:42.465667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:42.497271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.497761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.498157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.498440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.499237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] RBAC: Adding query filter params (group.id=911076f67eb7478bb39ce2b751a3b01a, role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=76e2202316cd48b390f80fdc501b381f) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:42.499827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:42.501187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:42.504051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:42.507264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 235/450] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/role_assignments?group.id=911076f67eb7478bb39ce2b751a3b01a&scope.project.id=76e2202316cd48b390f80fdc501b381f&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:42.579448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9456c2-dbf7-4a7f-9d11-c19f3ea15c86 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.615431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.616083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.616366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.616634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.617348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:42.617651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:42.619054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:42.628093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 216/451] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:42.634063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:42.651261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:42.737010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63d6d-43a5-48e2-ba1c-85fef9b664f5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:42.772578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:42.773416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:42.773783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:42.774054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:42.842249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:42.843719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:42.857535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:42.941511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 236/452] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:42.947226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:43.041162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:43.045283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e96cc-9355-42ac-9676-bc87efe667c7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:43.080188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:43.080821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:43.081103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:43.081377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] PATH_INFO: `/v3/projects/05869adb61214f878dfb2cd13c841b78` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:43.082490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] RBAC: Authorizing `identity:get_project(project_id=05869adb61214f878dfb2cd13c841b78)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:43.083966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:43.085597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 217/453] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:04:42 2022] GET /identity/v3/projects/05869adb61214f878dfb2cd13c841b78 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:43.091278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:43.185156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9690-8649-49dd-bcce-caef3cba95f1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:43.197878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:43.218299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ae1e-f6c8-4ae7-b8a8-5e0c4818a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:43.218908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ae1e-f6c8-4ae7-b8a8-5e0c4818a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:43.219184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ae1e-f6c8-4ae7-b8a8-5e0c4818a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:43.219452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ae1e-f6c8-4ae7-b8a8-5e0c4818a9b7 None admin] PATH_INFO: `/v3/groups/10864a25607a46a8a499c22291af4e19` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:43.220534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ae1e-f6c8-4ae7-b8a8-5e0c4818a9b7 None admin] RBAC: Authorizing `identity:get_group(group_id=10864a25607a46a8a499c22291af4e19)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:43.221936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ae1e-f6c8-4ae7-b8a8-5e0c4818a9b7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:43.223438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 237/454] 10.222.0.27 () {56 vars in 1180 bytes} [Sat Oct 1 04:04:43 2022] GET /identity/v3/groups/10864a25607a46a8a499c22291af4e19 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:43.229769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:43.327528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc56be9-1167-4547-b4f9-d0312b532b79 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:43.358827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:43.359415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:43.359692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:43.359986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:43.360701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] RBAC: Adding query filter params (group.id=10864a25607a46a8a499c22291af4e19, role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=05869adb61214f878dfb2cd13c841b78) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:43.361007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:43.362424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c239f-692d-483f-927a-a802f4f8b7a2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:43.368476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 218/455] 10.222.0.27 () {56 vars in 1376 bytes} [Sat Oct 1 04:04:43 2022] GET /identity/v3/role_assignments?group.id=10864a25607a46a8a499c22291af4e19&scope.project.id=05869adb61214f878dfb2cd13c841b78&role.id=8fdee6d92c844466842df5998d45def4 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:45.930871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac3a8e-6fa8-44ce-a749-3fab3344cb98 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:45.931740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac3a8e-6fa8-44ce-a749-3fab3344cb98 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:45.932181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac3a8e-6fa8-44ce-a749-3fab3344cb98 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:45.933648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 238/456] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:45.940260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d82c6-e1f4-4dea-9e3a-39b26d28352d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:45.940691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d82c6-e1f4-4dea-9e3a-39b26d28352d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:45.940808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d82c6-e1f4-4dea-9e3a-39b26d28352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:45.967471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-890d82c6-e1f4-4dea-9e3a-39b26d28352d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:45.968890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-890d82c6-e1f4-4dea-9e3a-39b26d28352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:46.005037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:46.033770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c07e7-dafc-40d3-97ca-b7b6f0cba4de None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.033770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c07e7-dafc-40d3-97ca-b7b6f0cba4de None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.033770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c07e7-dafc-40d3-97ca-b7b6f0cba4de None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.035479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 239/457] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:46.041190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50991-2dc8-48a3-a5b2-6efcfc87dce9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.041865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50991-2dc8-48a3-a5b2-6efcfc87dce9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.041865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50991-2dc8-48a3-a5b2-6efcfc87dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.072647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-99b50991-2dc8-48a3-a5b2-6efcfc87dce9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:46.073858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-99b50991-2dc8-48a3-a5b2-6efcfc87dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:46.077163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 219/458] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:46.175150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401cada-0570-4fee-a92d-75ae2fb563cc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.175330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401cada-0570-4fee-a92d-75ae2fb563cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.175623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401cada-0570-4fee-a92d-75ae2fb563cc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.175863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 240/459] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:46.177179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 220/460] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:46.205799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.206120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.206358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.233172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:46.234364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:46.334331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 241/461] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:46.366331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401cada-0570-4fee-a92d-75ae2fb563cc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:46.515826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401cada-0570-4fee-a92d-75ae2fb563cc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:46.562857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:46.563730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.564167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.564603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.565619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:46.585103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:46.586620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:46.610524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:46.611665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:46.612761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:46.612761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:46.612761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:46.612761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 221/462] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:46.621513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:46.648371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:46.660739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:46.744698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c2818-9c28-4f5e-9187-286e050d85be None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:46.779734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9d318-dd79-4446-8eaa-276f2d011b06 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:46.785244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:46.785884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.786159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.786427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.798815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:46.800384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:46.819438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:46.821068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:46.822396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:46.822396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:46.822396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:46.822396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 242/463] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:46.822613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:46.822613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.822753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:46.823000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.829095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.830050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:46.830534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:46.832175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:46.850623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 222/464] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:46.852387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:46.924674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:46.933009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:46.942831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9371-39b2-482f-b108-644b88c5c06e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:46.956492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff1bc-6f50-4a7f-84c4-6ba408651a01 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:46.978332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:46.978955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.979231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.979498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.990033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:46.991447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:46.995309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:46.996177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:46.996676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:46.997199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:46.998375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:46.998891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:47.000585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3952b0-aeeb-4760-95d6-76cea770832e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:47.005497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:47.006594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:47.008292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:47.008292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:47.008292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:47.012277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 243/465] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:47.013085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:47.016139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 223/466] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:47.017601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739b8d-8dfc-4f3c-a966-011c7477bf2d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.017892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739b8d-8dfc-4f3c-a966-011c7477bf2d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.018167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739b8d-8dfc-4f3c-a966-011c7477bf2d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.019757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 224/467] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:47.024392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739b8d-8dfc-4f3c-a966-011c7477bf2d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:47.117991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4df55-61b0-4bba-88e7-a9a165b8eba9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:47.141124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739b8d-8dfc-4f3c-a966-011c7477bf2d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:47.157394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:47.158011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.158297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.158563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.159212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:47.160679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:47.171692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:47.177680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:47.178659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.179848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.180598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.180959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:47.181547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:47.181848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:47.183325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c078-ff05-485f-a272-a12b21ae0681 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:47.188399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 244/468] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:47 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:47.189342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:47.205952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 225/469] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:47.207580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.208092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.208595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.231237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:47.232760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:47.309308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc363fe-39d4-4cdc-88d7-0336167dc349 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:47.314424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 226/470] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:47.315558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:47.385298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:47.385851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.386132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.386405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.387058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:47.388530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:47.418107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 245/471] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:47 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:47.435876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b6e70-40a3-42ce-a298-f92d41f0954c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:47.464809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:47.479011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1a20a-35af-4da2-8998-54e4f3b553a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:47.480046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1a20a-35af-4da2-8998-54e4f3b553a7 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.480523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1a20a-35af-4da2-8998-54e4f3b553a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.481007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1a20a-35af-4da2-8998-54e4f3b553a7 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.481962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1a20a-35af-4da2-8998-54e4f3b553a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:47.483775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1a20a-35af-4da2-8998-54e4f3b553a7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:47.512215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 227/472] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:47 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:47.667780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:47.731357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:47.763596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c48c12-2d32-4c91-84fc-b5aca22e67de None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.763876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c48c12-2d32-4c91-84fc-b5aca22e67de None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.764181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c48c12-2d32-4c91-84fc-b5aca22e67de None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.765756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 228/473] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:47.771227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.771583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.771777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.785249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ceb80-63de-4db3-8f2b-6f90948c3b4e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:47.792378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:47.793596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:47.837414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:47.838163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:47.838511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:47.838789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:47.852080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:47.854341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:47.873580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:47.874527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:47.875374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:47.875374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:47.875374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:47.877909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 246/474] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:47.884068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:47.889239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 229/475] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:48.012642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b9d8-e862-437b-949d-392ec4d5922c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:48.027017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:48.061583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:48.062194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:48.062465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:48.062741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:48.063380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:48.063680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:48.065066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:48.087728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 247/476] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:04:48.092873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:48.220308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:48.234825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce134d92-9fb8-49dc-9c71-5b5a10b33bcd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:48.256278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:48.316811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b581-62ab-414a-b561-97b75456735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:48.317317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b581-62ab-414a-b561-97b75456735e None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:48.317595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b581-62ab-414a-b561-97b75456735e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:48.317861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470b581-62ab-414a-b561-97b75456735e None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:48.318532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b581-62ab-414a-b561-97b75456735e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:48.320031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470b581-62ab-414a-b561-97b75456735e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:48.348174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b9b1-d003-4726-b5d7-a00b261f01b8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:48.362378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 230/477] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:48 2022] POST /identity/v3/users => generated 249 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:48.387309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:48.387924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:48.388228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:48.388503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:48.389184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:48.390543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:48.399451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.sql.core [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 01 04:04:48.399451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 01 04:04:48.399451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [parameters: {'id': 'cdf80c4ff6da4c4991485ef1b3e3c8b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 01 04:04:48.399451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81721) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application conn.query(q) Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result.read() Oct 01 04:04:48.417129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return ref.to_dict() Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 04:04:48.418197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application next(self.gen) Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application yield resource Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application next(self.gen) Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.session.rollback() Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.force_reraise() Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise self.value Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application session.commit() Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 01 04:04:48.419148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._prepare_impl() Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.session.flush() Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._flush(objects) Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application compat.raise_( Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application flush_context.execute() Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rec.execute(self) Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 04:04:48.420054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 04:04:48.420916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application conn.query(q) Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application result.read() Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 04:04:48.421726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [parameters: {'id': 'cdf80c4ff6da4c4991485ef1b3e3c8b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:48.422502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 01 04:04:48.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:48.425701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 248/478] 10.222.0.27 () {60 vars in 1131 bytes} [Sat Oct 1 04:04:48 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:48.425838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b581-62ab-414a-b561-97b75456735e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:48.595609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470b581-62ab-414a-b561-97b75456735e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:48.632755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b799a44-7ddb-4b02-b306-87b8e0a5d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:48.633389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799a44-7ddb-4b02-b306-87b8e0a5d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:48.633664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799a44-7ddb-4b02-b306-87b8e0a5d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:48.633933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799a44-7ddb-4b02-b306-87b8e0a5d6d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:48.644528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799a44-7ddb-4b02-b306-87b8e0a5d6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1b799a44-7ddb-4b02-b306-87b8e0a5d6d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:48.650271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:48.651137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:48.651927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 231/479] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:04:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:48.661014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:48.705100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:48.786054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab234877-18da-4aa5-9e09-4344e13804bd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:48.820933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:48.821799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:48.822220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:48.822635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:48.823437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:48.823874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:48.825421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf7f6-daed-4208-8608-ad5ee5130755 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:48.834169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 249/480] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:50.138137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d69f3-5c24-4010-9916-c7ba409376c7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.138636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d69f3-5c24-4010-9916-c7ba409376c7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.138636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d69f3-5c24-4010-9916-c7ba409376c7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.140277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 232/481] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:50.146455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1363c5-35c3-4da1-8410-6e18b29abb23 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.146947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1363c5-35c3-4da1-8410-6e18b29abb23 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.147022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1363c5-35c3-4da1-8410-6e18b29abb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.165483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1b1363c5-35c3-4da1-8410-6e18b29abb23 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:50.166648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1b1363c5-35c3-4da1-8410-6e18b29abb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:50.252565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 250/482] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:50.257611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7893e-200e-4b05-b637-303035196296 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.257889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7893e-200e-4b05-b637-303035196296 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.258155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7893e-200e-4b05-b637-303035196296 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.259466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 233/483] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:50.264759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.265042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.265315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.287868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:50.289164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:50.293517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a8d1f-3445-4f98-99cc-091b917181b3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.293798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a8d1f-3445-4f98-99cc-091b917181b3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.294074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a8d1f-3445-4f98-99cc-091b917181b3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.296707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 234/484] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:50.301726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.302004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.302273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.327559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:50.333414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:50.334653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:50.369390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:50.413330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 235/485] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:50.442497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 251/486] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:50.719040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:50.721745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:50.854254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d27f-5673-4c52-8fcf-daf9f9b04d7e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:50.861729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617928-a4a2-4df1-b5dd-e4e5260af627 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:50.891557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:50.892484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.893111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.893535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:50.908846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:50.909019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:50.909397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:50.909764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:50.914723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:50.915910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:50.916959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:50.919444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 252/487] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:04:50.920545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:50.931918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:50.937110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:50.938068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:50.938900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:50.941589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 236/488] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:50.942631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:50.948967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:50.960860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.046507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30111373-69c5-48e3-a2ac-28c20108d735 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.047954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073898b-bd55-4c8c-9f28-de333cfea391 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.081519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.082141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.082423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.082692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.087908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.088526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.088801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.089068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.089754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:51.090055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.091407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a52fe-91ef-4369-a871-bac0f0c9706a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.092979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:51.097750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:51.098632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:51.099446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 253/489] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:51.100138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 237/490] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:51.105774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93771-2d57-4461-af4c-c47209fd69b4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.105774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93771-2d57-4461-af4c-c47209fd69b4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.105774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93771-2d57-4461-af4c-c47209fd69b4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.105774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 238/491] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:51.106081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.108258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93771-2d57-4461-af4c-c47209fd69b4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.183173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.191481 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.210945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d1722-cc4f-4fb4-a338-0c1c2c005c3c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.217390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93771-2d57-4461-af4c-c47209fd69b4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.251582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.252473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.252749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.253026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.253708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:51.253987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.255355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.255637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.256307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.256588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.257537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.269710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 254/492] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:51.269710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.274183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.275633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-937a22a3-7349-4797-b601-1f4b4103b4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:51.291791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:51.292770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:51.293702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:51.293702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:51.293702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:51.293702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 239/493] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:51.295598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.296120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.296401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.314617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:51.315728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:51.381113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f017-7553-4926-875f-0ae522b87f7d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.386720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 240/494] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:51.387579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.425974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.426963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.427393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.427814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.428786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:51.429791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.431478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.434375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.446938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 255/495] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:51.448048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.466143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.519792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc1222-c4af-4dca-bf59-65da53741086 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.563081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.563969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.564267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa0803-4b1f-4bfd-bbcd-be66dd5de203 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.564588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.565061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.583967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.583967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:51.603503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:51.604711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:51.605748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:51.605748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:51.605748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:51.605911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.605911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.605911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.606220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.606808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:51.607013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 241/496] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:51.607116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.608115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.608696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.630925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 256/497] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:51.632358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.705174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.724001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589ec39-cbdc-4131-89da-ae429cb67ce9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.736643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.749673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba15e1-a3c0-47bb-83bc-f292da001479 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.764990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.765632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.765908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.766177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.777486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.778946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.783706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.784348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.784625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.784894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.785526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:51.785820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.787161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:51.793385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:51.794325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:51.795171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:51.795171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:51.795171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:51.795171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 242/498] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:51.795383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.805839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 257/499] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:51.805839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.894530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab62c0-c250-47e5-b13d-0e6238cf2945 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.902416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9455-3009-4b92-bfd7-90a84d1a20df None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:51.919441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:51.927065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.927691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.927983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.928256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.935556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:51.937103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:51.937484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:51.938117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.938398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.938664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.949401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d7030c2b-6324-47f4-aa30-d18834c9754c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:51.950179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:51.951222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:51.952175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 243/500] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:51.952756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692c52-ae4a-496c-9b11-399499fc8069 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:51.952756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692c52-ae4a-496c-9b11-399499fc8069 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:51.952926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692c52-ae4a-496c-9b11-399499fc8069 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:51.954286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 244/501] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:51.954380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:51.955271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:51.956519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 258/502] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:51.957329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.958860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692c52-ae4a-496c-9b11-399499fc8069 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:51.983519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.058241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768c9f-b332-4e89-adcf-8ece66322675 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.060404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692c52-ae4a-496c-9b11-399499fc8069 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.091582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.092159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.092436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.092702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.094181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.094784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.095061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.095337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.095996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:52.096304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.097684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.099647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.101121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.109164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 245/503] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:52.109958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-90e3eac3-a6f4-4cb9-aee9-f28846b0bb3a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:52.113509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:52.114560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:52.115473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 259/504] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:52.116077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.116291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.116587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.134022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:52.135194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:52.165289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.197357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.203486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 260/505] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:52.204776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.229780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d2a1-4c3f-4c2f-bdff-177ad99d5e1b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.266150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.266755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.267033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.267304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.268058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:52.268363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.270065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.306261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48160500-27f6-4f0f-a596-8583c4ae3888 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.312252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 246/506] 10.222.0.27 () {56 vars in 1137 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:52.312252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.348367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.348930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.349218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.349494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.350163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:52.350469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.352419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.365031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 261/507] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:52.365031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.395474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.418620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3137553-3f37-4be9-a765-828cfb60c047 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.458020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.459109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.459440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.459719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.470040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.470734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9db263-c2ba-41b7-9414-d285c2f8e621 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.471493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.474913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:52.486791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:52.487790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:04:52.488711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:52.492078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 247/508] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:52.493078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.505606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.506212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.506488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.506756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.508093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:52.508395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.509841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.545304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 262/509] 10.222.0.27 () {56 vars in 1137 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:52.546119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.595306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd5b1-4c56-4b81-a8c2-2dfa71b118c9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.633410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.637106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.637728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.638001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.638930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.645745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340adb8-c59c-44a3-b45b-83f240fae378 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.679896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.680579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.680853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.681116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.690679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.692155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.703399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.705939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:52.707037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:52.707924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:52.708799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:52.708799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:52.708799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:52.708960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.709026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 263/510] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:52.709026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.806616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac8cfe-c8c5-4262-8f47-c97ff6b4d028 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.807422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 248/511] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:52.809823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.842385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.843016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.843293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.843559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.852108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.854121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.856214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:52.871334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:52.872417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:52.873266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:52.873266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:52.873266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:52.873266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 264/512] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:52.873266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.910413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:52.913911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280be7f-4790-4fe1-bd0d-0c0eb59e6e99 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:52.948184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:52.948795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:52.949075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:52.949350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:52.950067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:52.950374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:52.951801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:52.969321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 249/513] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:52.970141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:52.972467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b0f7-0b1e-4b27-96f6-d20906895147 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.005071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.005669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.005944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.006211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.062505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.069029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3269087-7b46-4acf-8837-e4fc1b695038 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.072716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.074155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.102630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.103226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.103498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.103769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.104420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:53.104714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.106054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.117440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 250/514] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:53.118207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.137729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.174384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 265/515] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:53.175152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.220733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23dba-e368-4360-8941-ff29586762c0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.253001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.253623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.253888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.254165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.262266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.264362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.265783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.271150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5247600-d3a1-434a-b947-a8b061020fb9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:53.280304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:53.281201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:53.282058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:53.282058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:53.282058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:53.282058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 251/516] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:53.282269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.305191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.305792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.306070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.306341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.306973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:53.307276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.308648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.319512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 266/517] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:53.320264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.352432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.383829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964c3f-3cdb-4530-9c2f-4e9a620891ad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.416864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.417468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.417745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.417835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcc87-fc2a-4661-85d4-a1828a251407 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.418017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.450576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.451839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.452160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.452434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.459996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.461467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:53.472463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:53.473386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:53.474277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 267/518] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:53.474874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.487364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.488853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.490734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.555384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.574627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088bc1e-7435-4cc3-b79a-408666e34089 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.587684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 252/519] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:53.588527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.610928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.611543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.611821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.612129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.622746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.624219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:53.637756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:53.638664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:53.639505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:53.639505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:53.639505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:53.639505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 268/520] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:53.639732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.686365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a3a29-0b13-47ba-8f7e-9b0e5e512c46 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.699391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.720063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.720601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.720878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.721149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.721775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:53.722075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.723440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.734894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 253/521] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:53.735809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.741972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa2642-7770-4621-867f-444bcc022845 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.764306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.775940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.776562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.776838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.777112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.777747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.779157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.800123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 269/522] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:04:53 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:04:53.800936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.843580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85438c6-b6d1-4394-9e5b-c3f5e6428ce6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.880345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.880972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.881251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.881525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.882322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:53.882629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.884130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:53.909274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 254/523] 10.222.0.27 () {56 vars in 1139 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:53.910505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:53.932230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f5495-8ea2-43f1-b10c-c7a628e75fa4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:53.955654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:53.972339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:53.973261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:53.973606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:53.973951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:53.987206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:53.988739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:54.004907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:54.005862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:54.007269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:54.007269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:54.007269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:54.007269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 270/524] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:54.007269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.012324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.027195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acd30-74a2-4fc1-a7cd-6393bd5b7076 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.063378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.064043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.064329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.064601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.065242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:54.065542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.066907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.078799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 255/525] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:54.079448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.122516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301614c-cb07-4270-b3b9-2e233971a298 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.156462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.157095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.157372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.157646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.165043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.166489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:04:54.178695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:54.179616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 271/526] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:54.181103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.187266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d153-cff0-4217-92b9-ad78a482932c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.215149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.224258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.224827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.225086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.225359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.244213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.291059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6aa7-d7a4-42c2-965b-93e049c91c5c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.294863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.296508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.328372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.329042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.329317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.329588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.330319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:54.330625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.332965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.350414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 272/527] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:54.350414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.409627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 256/528] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:54.409627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.449657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.456005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.461458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1dace-a5ff-466a-8999-fe7541f75f36 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.500609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.501131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.501407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.501682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.508775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.510260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.517747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff3f48-49cf-43cf-8e96-7825bfba00d0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:04:54.521612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:54.523152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:54.524269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:54.528208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 273/529] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:54.528867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.557793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.558419 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.558690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.558964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.559654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:54.559983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.561414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.580482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 257/530] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:54.581276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.641873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2c89-1f2d-48fc-996a-e684b893055b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.676980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.677690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.678034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.678400 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.685318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e1833-e30e-433b-bf65-d9cf4eed4149 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.685846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.687403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.695033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:04:54.700815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:54.701653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:54.702488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 274/531] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:54.702941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.719694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.727596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.728278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.728559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.728833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.739140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.740609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:54.755542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:54.756462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:54.757438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:54.757438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:54.757438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:54.757438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 258/532] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:54.757438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.820063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43189f-6cd6-45da-b53f-2905a30f600d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.855192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.855795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.856181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.856452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.857145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:54.857448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.858868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.859730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927c27-1a96-4c37-8b61-3a964afca73e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:54.881896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 275/533] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:54.881896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.896746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:54.897377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:54.897661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:54.897930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:54.898651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=d1c891f90f1b4b508752dfebc1de3589) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:54.898955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:54.900436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:54.915966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 259/534] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/role_assignments?user.id=d1c891f90f1b4b508752dfebc1de3589&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:54.915966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:54.945776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:54.975381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:55.008128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047d616-4610-43aa-9248-d486a6c334fc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.047065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.047751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.048071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.048348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.049234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:55.049536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.051168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.052872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cb792-51f1-44e1-b0b4-f3f3b08b6fcb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.064392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 276/535] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:55.065396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:55.105849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.107640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.108129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.108501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.109334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:55.109739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.111248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.127642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 260/536] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:55.130557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:55.188307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97a785-d38b-4bca-9c1f-1565236f4b83 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.224780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:55.230783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.232002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.232282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:55.233095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.233575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.234594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=1afa3489655343c699a658472da4646b) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:55.235083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.237142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.256384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 277/537] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:55 2022] GET /identity/v3/role_assignments?user.id=1afa3489655343c699a658472da4646b&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:55.256384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:55.259576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7a87c-39fa-4566-aa73-863f242ee755 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.335876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.336583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.336864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.337216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.337960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=424b048ef3454b8597a80c0f605b4c64) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:55.338265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.339850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.355649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 261/538] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:55 2022] GET /identity/v3/role_assignments?user.id=424b048ef3454b8597a80c0f605b4c64&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:55.429553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389bbaa-503c-4cf4-9616-c1bc4a1de28f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.472515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.473173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.473518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.473796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.482311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.483857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:04:55.499967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:55.500867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:55.501702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 278/539] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:55.508308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:55.644219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7f25-f033-4964-b097-b96b686c8f81 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.693594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.694737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.695024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.695300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.696020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:55.696329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.697768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546cc64-facc-4cb2-8302-1e43dd1a346d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.710950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 262/540] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:55.717029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:55.793962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:55.849663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6f01-3fcc-4dc0-8f3b-ec53775642cc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:55.884644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:55.885252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:55.885533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:55.885799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:55.886524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=07cf20962b404013898ef0d093cf53ed) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:55.886827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:55.888328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1487060-9ee5-4ee3-8483-882219e43846 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:55.894561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 279/541] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:04:55 2022] GET /identity/v3/role_assignments?user.id=07cf20962b404013898ef0d093cf53ed&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:56.039800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33325ad6-76a3-46f5-ba7f-5d09f2a81051 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:56.040107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33325ad6-76a3-46f5-ba7f-5d09f2a81051 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:56.040384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33325ad6-76a3-46f5-ba7f-5d09f2a81051 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:56.041724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 263/542] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:56.058227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:56.058552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:56.058771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:56.078223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:56.079450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:56.153491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 280/543] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:56.630097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33325ad6-76a3-46f5-ba7f-5d09f2a81051 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:56.642555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:56.758180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33325ad6-76a3-46f5-ba7f-5d09f2a81051 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:56.800152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:56.800152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:56.800152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:56.800152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:56.813121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:56.817982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:56.818858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:56.819774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 264/544] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:56.826816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:56.906903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:56.963893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2183c8-2bf8-46c6-9aa0-591db2652317 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:57.001475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:57.002098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.002376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.002651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:57.003332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:57.003635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:57.005050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:57.014084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 281/545] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:57.020047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:57.181491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:57.230144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59233bac-8d3a-40fb-a3d2-9be1d013a015 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:57.272294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:57.273646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.274095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.274505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:57.284648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:57.286340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:57.305438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:57.306529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:57.307584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:57.307584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:57.307584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:57.308959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 265/546] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:57.314561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:57.467096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f5dc-a12a-40a4-abb1-8e848e4aa162 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:57.486049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:57.513271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:57.513888 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.514169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.514444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:57.515089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:57.515390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:57.516769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0dbc2-2963-49ee-8867-bbe30a294d38 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:57.535050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 282/547] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:57.540799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:57.574921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500e78-37d6-4423-ad6c-b703a7c34b93 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.575208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500e78-37d6-4423-ad6c-b703a7c34b93 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.575465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500e78-37d6-4423-ad6c-b703a7c34b93 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:57.577114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 283/548] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:57.581674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.581956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.582229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:57.612471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:57.613675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:57.706678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cc7e0-e3c6-42de-af37-48df6fbf8c79 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:57.745214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 284/549] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:04:57.745593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:57.760133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:57.760770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.761051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.761321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:57.777441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:57.779073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:57.791550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:57.793023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:57.794098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 266/550] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:04:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:57.801193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:57.948071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7f62f-1a1c-4431-83e6-e716b3bb71ef None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:57.949574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:57.998604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:57.999137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:57.999418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:57.999692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.000454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:58.000809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:58.002292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724948d-b58d-4b3e-be96-f14116ddfde9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:58.031983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 285/551] 10.222.0.27 () {56 vars in 1135 bytes} [Sat Oct 1 04:04:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:58.037492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.061561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea475-9de8-4a5e-8532-4b5c492ccaa1 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.061867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea475-9de8-4a5e-8532-4b5c492ccaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.062112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea475-9de8-4a5e-8532-4b5c492ccaa1 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.063686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 286/552] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:58.068699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.069634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.069907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.094798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:58.095988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:58.168159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 287/553] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:58.169011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.185701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43ae8-8f28-43ed-bc84-9e10ee8960f2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.222372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572f98-f9fa-4d8d-9235-7d860c891913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.223429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572f98-f9fa-4d8d-9235-7d860c891913 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.224053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572f98-f9fa-4d8d-9235-7d860c891913 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.224542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572f98-f9fa-4d8d-9235-7d860c891913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.272028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:58.292037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418b91-5205-405d-b56c-c61c4f18650a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.297019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:58.324219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572f98-f9fa-4d8d-9235-7d860c891913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:58.326047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572f98-f9fa-4d8d-9235-7d860c891913 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:58.343586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df3903-c5ca-46e4-b3e5-d87fada73a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.344505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3903-c5ca-46e4-b3e5-d87fada73a4e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.344780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3903-c5ca-46e4-b3e5-d87fada73a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.345104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3903-c5ca-46e4-b3e5-d87fada73a4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.361375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df3903-c5ca-46e4-b3e5-d87fada73a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-70df3903-c5ca-46e4-b3e5-d87fada73a4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:58.367424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:58.368398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:58.369264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:58.372072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 288/554] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:58.373831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826007ea-3560-4276-88e0-419695d35a2c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.375850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826007ea-3560-4276-88e0-419695d35a2c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.376304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826007ea-3560-4276-88e0-419695d35a2c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.377721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 289/555] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:58.379597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826007ea-3560-4276-88e0-419695d35a2c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.459170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 267/556] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:04:58.460739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.461451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.462581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.480553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:58.481782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:58.499143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826007ea-3560-4276-88e0-419695d35a2c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.538899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.539627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.539869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.540188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.540873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:58.541184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:58.542728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:58.556103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 290/557] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:58.556103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.567148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 268/558] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:58.567148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.570928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:58.581004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:58.675225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab4df-071c-4117-b494-00b4a61abf80 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.693845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c27f3-7952-4708-9955-bd6ccf29df26 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.712761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.713574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.714020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.714457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.725870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:58.728903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.729535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.729814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.730086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:58.732314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:58.733406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:58.734531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:58.736916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 291/559] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:58.737856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.740479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:58.743072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a5a1f74d-675e-48dc-9a66-6f1343f44375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:58.757658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:58.758812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:58.759712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:58.759712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:58.759712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:58.759712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 269/560] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:58.760045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21311-78a6-433e-804b-25a6b6c7f117 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.760185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21311-78a6-433e-804b-25a6b6c7f117 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.760463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21311-78a6-433e-804b-25a6b6c7f117 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.761822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 270/561] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:04:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:04:58.762363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21311-78a6-433e-804b-25a6b6c7f117 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.830362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:58.833293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:58.866824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4b2a6-23b3-4f59-8262-f9b99bf012b4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.870666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21311-78a6-433e-804b-25a6b6c7f117 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:58.898726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.899343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.899619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.899893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.903582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:58.904309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.904591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.904863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.905520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:58.905822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:58.907176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:58.910461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:58.912346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:58.915846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 271/562] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:58.916661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ec343975-bafc-45b5-98e7-d29069e7ddd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:58.929656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:58.930767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 292/563] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:58.936387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:58.951906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:04:58.953129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:04:59.017054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 293/564] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:04:59.017363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a0ca-8f27-4625-99f0-38f17823cfd5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.017920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.048241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.061657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.062268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.062565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.062814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.063449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:59.063751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.065141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.075252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.078795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 272/565] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:59.079597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.127686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62e449-dabb-4970-baf9-9157b395750b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.165138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.165826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.166107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.166493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.177382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:59.183215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.184167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:59.185032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 294/566] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.185718 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f1366-c4e4-4d0f-9456-120d6442feb8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.185791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.222770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.223402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.223681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.223974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.235827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.237310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:59.252336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.253463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:59.254661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:59.254661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:59.254661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:59.257926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 273/567] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.258764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.294065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.296547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2d32-0ad7-4625-af68-2a19f0fb9b19 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.310791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.330892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.331485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.331761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.332058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.332691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:59.332988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.334380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.345121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 295/568] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:59.345898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.357863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab7908-d0be-4efb-8e70-e4e0a3f3924a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.391670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.392261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.392533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.392800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.399511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.400981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:04:59.412438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.414024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 274/569] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.415128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.447264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8674a-30a6-4dd5-896d-574078bf0b28 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.481040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.481642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.481923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.482197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.482855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:59.483156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.484544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.492301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 296/570] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:59.493083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.517283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.524023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a31f1e-aeaf-4442-a3f5-f4ec56db0e46 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.527988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.557557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.558154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.558438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.558704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.559332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:59.559634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.561038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.572890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 275/571] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:59.573671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.596431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456551a-a15b-48db-8964-40d12d0fa9ba None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.630281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.630902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.631177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.631445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.641289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:04:59.646813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.647798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 297/572] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.648688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.674792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040ef5-9ae9-42b0-86a1-0458646d6c93 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.707809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.708463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.708740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.709013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.716283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.717708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:59.729589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.731010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 276/573] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.731987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.741809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.748042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c3bf8-4c4f-43b0-ac06-7c9eaf499763 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.749870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.782727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.783318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.783592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.783858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.784593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:04:59.784887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.786287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.798469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 298/574] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:04:59.799238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.834185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4885a-f41d-44a8-a4bd-34bf7851a628 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.867707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.868360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.868646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.868915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.879042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.880511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:04:59.894875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.896121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:04:59.897603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:04:59.897603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:04:59.897603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:04:59.897603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 277/575] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.897603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.904896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17725-3b71-4941-b4b7-138c17d12e15 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:04:59.939081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:04:59.939700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:04:59.940016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:04:59.940289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:04:59.947607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:04:59.949060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:04:59.960298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:04:59.961860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:04:59.963052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:04:59.965030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:04:59.965901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 299/576] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:04:59.966681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:04:59.983876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.000037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b628ce-b070-4f8f-b8fe-fec0134580fd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.034230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.034829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.035111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.035439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.036202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.036510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.037899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.045577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 278/577] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.046348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.069503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dcd9b-7104-4477-a75c-d4f5cc7e5d31 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.102165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.102761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.103044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.103543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.104067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.104376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.105820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.123052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 300/578] 10.222.0.27 () {56 vars in 1137 bytes} [Sat Oct 1 04:04:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.123842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.145210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c50f9-9c51-4bbc-8583-abbcc5a00f62 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.172469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.179314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.179913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.180219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.180493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.181208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=afc96390262a4509ba740d0708ae26aa) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.181513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.182932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.188138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 279/579] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/role_assignments?user.id=afc96390262a4509ba740d0708ae26aa&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.188910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.208074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.237044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31995f-81d2-4d99-85ed-6eae251ca1f1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.276293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.276919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.277192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.277470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.278118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.278423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.279807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.297826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 301/580] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.297826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.310013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c4acd-c436-42fb-bdd9-f18b1de13d92 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.347256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.348325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.348775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.349046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.349791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.350131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.351589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.375242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 280/581] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.375242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.407194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07381d6b-0f93-45d6-8bf8-294f5d82bcd8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.442964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.443519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.443828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.444130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.444233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.446503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.456073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.457530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:00.474786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:00.476418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:00.477349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:00.477349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:00.477349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:00.478160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 302/582] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:00.478975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.504239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65719c0d-c7c2-47ff-8a35-6a49eb581081 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.539873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.540525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.540807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.541078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.551059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.552543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:00.567748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:00.568943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:00.570123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:00.570123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:00.570123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:00.573525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 281/583] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:00.574269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.595539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b15741-a1f9-4bae-838e-9d155e13d857 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.635286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.636238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.636521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.636791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] PATH_INFO: `/v3/users/glance` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.645156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.646800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:00.660972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:00.661992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 303/584] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:00.663040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.682952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9ceae-26e5-4cd5-9ca4-7a22b5ed7610 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.685328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.711179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.729664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.730301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.730584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.730856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.742287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.743747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:00.759256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:00.760261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:00.761158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:00.761158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:00.761158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:00.761158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 282/585] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:00.761158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.775347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475b73-3a5c-4756-ba35-3bb3b03b8dda None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.813604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.814214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.814501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.814759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.815408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.815714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.817114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.837493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 304/586] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.837493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.873932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f99fc-83cf-4a30-b3ea-f807a89527e7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.910488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.911281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.911646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.911994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.913369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.913678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.915152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:00.928472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 283/587] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:00.928472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:00.941645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec416b-d204-4fad-acf7-6ebf16b5e624 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:00.949364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.949974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:00.978805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:00.980156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:00.980445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:00.980723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:00.981454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:00.981761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:00.983179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.001072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 305/588] 10.222.0.27 () {56 vars in 1137 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:01.001854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.047812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df4a2-8dfd-465d-a0f5-b4f84d572c83 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.085100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.085717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.085992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.086263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.086891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:01.087190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.088620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.105137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 284/589] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:01.105137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.112196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616e70-503e-457a-84fd-d4eca052fe32 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.148185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.148813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.149096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.149367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.156787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.158217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:01.170711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:01.171757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 04:05:01.173288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:01.176491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 306/590] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:01.177095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.187008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.202770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.214573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5740b-9718-462f-803e-458e622cd0ad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.252171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.253019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.253302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.253578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.260359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.261797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:01.273969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:01.274881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:01.275770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:01.279985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 285/591] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:01.280811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.284927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca64620-fc88-4515-9620-4d4c4b574656 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.320599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.321641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.321931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.322205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.333286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.335248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:01.349395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:01.351140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:01.356975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:01.356975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:01.356975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:01.356975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 307/592] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:01.356975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.393514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c06f-7181-4aeb-b1a9-f6d920bee058 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.431759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.432423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.432702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.432975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.435618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.438605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.441509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.443379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:01.455191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:01.456407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:01.457453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 286/593] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:01.458306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.470431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f67da-3d07-4f86-a5aa-cadff3eaf52a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.506262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.506807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.507256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.507530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.508293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:01.508591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.510044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.528240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 308/594] 10.222.0.27 () {56 vars in 1139 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:01.529038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.569430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f67d-5bb8-4a4f-99e9-4aa93740a327 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.604438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.605291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.605436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.605590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.606276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:01.606584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.608047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.624937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 287/595] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:01.624937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.650993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19957dae-75c8-48f2-81df-a4cd9fb34371 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.677167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.688801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.689482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.689912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.690254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.691063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:01.691463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.692964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.694894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.707433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 309/596] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:01.708156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.726471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c8ea-ab07-4d36-82c0-a2a5235cba7b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.760163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.760804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.761049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.761231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.761925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:01.762231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.763668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.775324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 288/597] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:01.776120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.825268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7ee5-a845-48a8-be41-94ce430c5ce7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.864262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.864896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.865167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.865433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.878969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.880518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.885261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b6c5-232a-49b2-a491-8ecb00005b9a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:01.896806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:01.898459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:01.904578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:01.904578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:01.904578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:01.904578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 310/598] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:01.904578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.904895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:01.923438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:01.924128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:01.924406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:01.924678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/d1c891f90f1b4b508752dfebc1de3589/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:01.939399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=d1c891f90f1b4b508752dfebc1de3589, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:01.940858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:01.963965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 289/599] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:01 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/d1c891f90f1b4b508752dfebc1de3589/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:01.963965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:01.964966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:02.031881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ab5ab-7d62-414e-868e-6f9cd637ddfe None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.079747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.080428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.080704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.080967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.091182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.092668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:02.105453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:02.106496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:02.107417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 311/600] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:02.107924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:02.109926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37836287-f4fe-4853-8358-33073028f8ed None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.162213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.163315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.163806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.164340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/424b048ef3454b8597a80c0f605b4c64/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.183918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=424b048ef3454b8597a80c0f605b4c64, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.186047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.202188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 290/601] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:01 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/424b048ef3454b8597a80c0f605b4c64/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:02.202815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:02.230405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:02.240196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35de10-2f6c-455d-a316-b6a4cf7947e9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.254089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:02.294527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.295905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.297022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.297810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.298858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:02.299380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.301110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.320998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 312/602] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:02.323190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:02.349723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acbf4-4e05-4028-9d85-36de1041054a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.402478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.403213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.403497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.403767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.404510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:02.404815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.406365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c66e7-0db2-4747-b766-5da012c87ba9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.420453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 291/603] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:02.422553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7248beb-c7f7-4e61-9157-ea72290eafa0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.423241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7248beb-c7f7-4e61-9157-ea72290eafa0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.423522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7248beb-c7f7-4e61-9157-ea72290eafa0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.429522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 292/604] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:02.430429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7248beb-c7f7-4e61-9157-ea72290eafa0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:02.471806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b765d-8ccf-456b-901a-22020199c1c9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.521139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.522490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.522865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.523237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.526087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:02.533963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.535770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a2237a12-1fdd-4e89-a41a-69c2e29cb1a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:02.550426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:02.551536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:02.552668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:02.553307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 313/605] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:02.555812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.555812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.555812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.557667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7248beb-c7f7-4e61-9157-ea72290eafa0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.577869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:02.579801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:02.597914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.598576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.598849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.599121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/1afa3489655343c699a658472da4646b/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.614393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:02.617864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=1afa3489655343c699a658472da4646b, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.620780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.639532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 293/606] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:02 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/1afa3489655343c699a658472da4646b/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:02.641123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:02.670955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 314/607] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:02.785546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfaee9-3085-4f21-9b4b-d935b45f152c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:02.819365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:02.830701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:02.831585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:02.832111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:02.832678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:02.833595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:02.834119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:02.836319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:02.849431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 294/608] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:02.855760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:02.974597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bca49-0e91-4a95-92df-b4d947d79b04 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:03.010747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:03.011764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:03.012310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:03.012797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/07cf20962b404013898ef0d093cf53ed/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:03.018841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:03.033186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=07cf20962b404013898ef0d093cf53ed, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:03.034632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:03.063028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 315/609] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:02 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/07cf20962b404013898ef0d093cf53ed/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:03.141045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0714d8-324e-4892-906b-364e2825ab70 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:03.179476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:03.180619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:03.181107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:03.181706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:03.194377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:03.200308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:03.201272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:03.202145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:03.208319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 295/610] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:03.213100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:03.228088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:03.365246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929c0e-5095-4b0b-a6b3-3b15f0eb08b8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:03.405813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:03.406768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:03.407260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:03.407762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:03.408652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:03.409169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:03.410737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:03.424042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 316/611] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:03.426250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:03.528602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:03.614679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3946652-2f7e-4bf6-9024-c5e30bd02586 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:03.696749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:03.697315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:03.697596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:03.697870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:03.718125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:03.719656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:03.753293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:03.754325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:03.755233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:03.755233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:03.755233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:03.755233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 296/612] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:03.761217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:03.848788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:03.886446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2da36-cf17-4054-ab0d-f16148ea81c3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:03.929972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:03.930647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:03.930934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:03.931217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:03.931868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:03.932201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:03.933639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:03.947162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 317/613] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:03.952755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:04.108619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:04.115528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10153ab-3f88-437f-80b1-e3767b5f7cae None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:04.171302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:04.171966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:04.172240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:04.172514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:04.184756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:04.186227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:04.204819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:04.205787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:04.206752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 297/614] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:04.212737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:04.372668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593814f-fc43-4052-83c6-df5b55c28b34 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:04.404298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:04.421526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:04.422384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:04.422839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:04.423281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:04.424203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:04.424659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:04.426235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c179133-87b7-4578-86cd-693b3325150a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:04.451064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 318/615] 10.222.0.27 () {56 vars in 1135 bytes} [Sat Oct 1 04:05:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:04.452702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:04.631831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e702-19b5-4ae0-8883-424361d73915 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:04.645432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1adf0-8c96-4550-90f7-f042b513a675 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:04.645944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1adf0-8c96-4550-90f7-f042b513a675 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:04.646398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1adf0-8c96-4550-90f7-f042b513a675 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:04.648263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 319/616] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:04.653449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:04.653449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:04.653678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:04.685030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:04.687636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:04.708410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:04.709853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:04.711387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:04.711832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:04.733927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:04.736016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:04.770397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:04.771452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:04.776910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:04.776910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:04.776910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:04.776910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 298/617] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:04.790825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:04.812771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 320/618] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:04.820972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:04.953545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c1f3c-0b81-4115-959c-048ba51d7889 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.005802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.006475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.006749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.007018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.007671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:05.007991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:05.009384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65240d-8496-4dfa-a405-a6b1dc249a26 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:05.029327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 299/619] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:05.037080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.160861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb816ff-ab62-4009-97ab-d5c817011174 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.161235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb816ff-ab62-4009-97ab-d5c817011174 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.161511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb816ff-ab62-4009-97ab-d5c817011174 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.164775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 300/620] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:05.179173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.179493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.179706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.189533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff06bc-d788-4c75-a97e-faec0a72e73c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.214344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:05.214804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:05.215466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:05.241866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.242505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.242778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.243048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.249884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:05.251329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:05.262620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:05.263594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 321/621] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:05.264933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.315198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:05.329728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 301/622] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:05.329728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.388909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80030074-34a9-4e1a-bb43-c07daac4b46b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.428464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.429483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.429968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.430963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.443259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:05.450008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:05.450976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:05.451830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:05.459698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 322/623] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:05.461653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.537059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:05.569299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a441301-a8d1-4aa2-9a8b-aaf53c80a53d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.630292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.632412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.632925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.633567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.634784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:05.635549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:05.637709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4339a3-a1d9-46d3-b710-b500b86ef823 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:05.640050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c952-c0d1-4e22-854e-6492ae89f641 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.653498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 302/624] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:05.655672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be025e-c0c2-47a7-a047-6fcdf49e4d33 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.656472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be025e-c0c2-47a7-a047-6fcdf49e4d33 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.656956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be025e-c0c2-47a7-a047-6fcdf49e4d33 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.659154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 303/625] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:05.660129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be025e-c0c2-47a7-a047-6fcdf49e4d33 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.681475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.682089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.682372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.682711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.683375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:05.683678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:05.685062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35976f-6903-4157-8620-f1b34d6cc43b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:05.696009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 323/626] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:05.696009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.696009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.696009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.712609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:05.713796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:05.727639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:05.775676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be025e-c0c2-47a7-a047-6fcdf49e4d33 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.786204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 324/627] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:05.787057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.816333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:05.835978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.835978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.835978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.835978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/afc96390262a4509ba740d0708ae26aa/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.849184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=afc96390262a4509ba740d0708ae26aa, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:05.851454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:05.872039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 304/628] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:05 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/afc96390262a4509ba740d0708ae26aa/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:05.873121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.909165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f8639-c373-45e5-9fb8-b8be4cfa879f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:05.949340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dae0-a0ed-44b8-8e76-dc7c6cb9b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:05.949994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dae0-a0ed-44b8-8e76-dc7c6cb9b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.950271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dae0-a0ed-44b8-8e76-dc7c6cb9b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.950546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dae0-a0ed-44b8-8e76-dc7c6cb9b6c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.963688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27dae0-a0ed-44b8-8e76-dc7c6cb9b6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-8e27dae0-a0ed-44b8-8e76-dc7c6cb9b6c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:05.968659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:05.969657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:05.970930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 325/629] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:05.972226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8ed4-0122-4fae-8cf6-e51d1b166469 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:05.972226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8ed4-0122-4fae-8cf6-e51d1b166469 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:05.972226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a8ed4-0122-4fae-8cf6-e51d1b166469 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:05.977302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 326/630] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:05.978171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8ed4-0122-4fae-8cf6-e51d1b166469 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:05.999899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c6108-42b9-4817-be7b-b35f984f5453 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.016253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.051637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.052756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.053582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.054130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.068831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.070286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.083621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-42d89bea-df32-4f99-849e-6d669343d27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:06.087541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:06.088616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:06.089513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:06.089513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:06.089513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:06.089513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 305/631] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:06.089946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.090453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.090565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.101639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a8ed4-0122-4fae-8cf6-e51d1b166469 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.108952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:06.110300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:06.136637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.137249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.137526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.137799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.138465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:06.138774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.140154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.152034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 327/632] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:06.152034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.181153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 306/633] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:06.182003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.272362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1ff6-bd10-4ca8-90b8-00f187f52833 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.296711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.309934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5146e-877d-4eb5-a9fb-2390e27ba46c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.314053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.314927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.315386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.315834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.327920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:06.333731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:06.334921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:06.335762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:06.339003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 328/634] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:06.340107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.350649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.351986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.352416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.352804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.354007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:06.354418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.355790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.357153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.378380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 307/635] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:06.378380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.463807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedcb09-6649-40dd-b114-588af4d8be8d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.499314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.499999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.500498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216907bb-7efe-4308-b6d9-ceddc76d931f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.500640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.500835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.512115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.513546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:06.528794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:06.529829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:06.530751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:06.530751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:06.530751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:06.530751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 329/636] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:06.530751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.541626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.542244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.542522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.542795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.543457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:06.543759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.545191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.553848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 308/637] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:06.554885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.571742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.607960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.653384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319f8d-4c23-4ce8-b5a9-0bc13b81cef3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.660144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69727992-dbb0-45a3-b14c-2d114b5166da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.691262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.692167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.692583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.693030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.696267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.697371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.697861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.698206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.703325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.705104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.708786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:06.714591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:06.715568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 309/638] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:06.716486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:06.721012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:06.722021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:05:06.722982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:06.723533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 330/639] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:06.724371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.798067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.830666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40b03-91a1-4bfb-bc10-51f5bebb8fa5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.839353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637ed2-e182-447a-b597-3a34e7192071 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:06.863898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:06.864053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.864673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.864953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.865805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.866902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:06.867207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.868618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.878440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:06.879092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:06.879370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:06.879640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:06.881107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 310/640] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:06.886163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.890994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:06.892464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:06.907296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:06.908340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:06.909304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:06.909304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:06.909304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:06.909304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 331/641] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:06.909304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:06.991098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63df62-1f53-4911-b324-f2c7111aae67 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.020711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54957edc-3137-4e44-a66e-271a0eb7da6c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.029025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.030247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.030589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.030866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.031523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:07.031829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.033207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.034756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.043804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 311/642] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:07.044646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.061168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.061777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.062052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.062327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.063047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:07.063350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.064786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.086919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 332/643] 10.222.0.27 () {56 vars in 1137 bytes} [Sat Oct 1 04:05:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:07.086919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.121725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.160974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493be3-fa5e-41fd-baf2-94bf61ae2bc3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.192091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5e7-ae45-45fb-b92a-6e8b027824b4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.196925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.197559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.197835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.198102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.205728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.207152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:07.220737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:07.221717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 312/644] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:07.222766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.239105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.240135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.241071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.241345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.242017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:07.242323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.243676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.255193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 333/645] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:07.256089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.290960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.340256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155497-6c00-464c-a1fc-9cd649a138d1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.353092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.362742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a56f-2c72-4b76-ab9d-2f2b18e548a0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.376173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.376788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.377075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.377351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.389352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.390793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.399453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.400487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.400773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.401054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:07.406280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:07.407228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:07.408149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:07.408149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:07.408149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:07.412006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 313/646] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:07.413637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.472196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.473980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.530741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec29b9-a796-4e24-bf2e-c90eeadf3fff None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.541626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.568417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.569554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.570169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.570450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.570715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.571549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:07.572096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.573469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.579538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 334/647] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:07.580204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.596060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 314/648] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:07.596912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.694009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d69f58-be94-471d-b439-b28b7f560df8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.703453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081766cd-ce6e-4777-94e3-8224c943a8e7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.729941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.730877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.731152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.731452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] PATH_INFO: `/v3/users/glance` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.739019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.740537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.741387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.741991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.742275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.742553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.743184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:07.743824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.744836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:07.752892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:07.753846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:07.754800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 335/649] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:07.755417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.766664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 315/650] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:07.766664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.794946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.816142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:07.867343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bc4b4-505b-46d4-95d7-1b1fb546fafe None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.879086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565f22-7f93-4afc-b486-a15fed200127 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:07.903175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.903711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.904030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.904312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.914821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:07.914991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.915431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:07.915704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:07.915998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:07.916379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:07.931526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:07.932699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:07.933777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:07.933777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:07.933777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:07.933777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 336/651] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:07.933777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:07.996900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:07.998370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.027393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.043446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3fc57-6429-48b7-948e-cf44732a8910 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.045777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.080382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.080992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.081277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.081552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.082307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:08.082629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.084107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.106156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 337/652] 10.222.0.27 () {56 vars in 1137 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:08.106156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.111940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 316/653] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:08.112866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.205098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404de9d-384c-45e7-9ba3-e4f3b00acedb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.210806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea9aeb-8994-47ea-adc1-36064ba0d152 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.235963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.238992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.239627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.239906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.240722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.245418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.246025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.246303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.246572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.247256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:08.247505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.247605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.248905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468c1c3-c8bc-497a-8709-b329986419c4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.249016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.259787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 317/654] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:08.260740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:08.261659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 01 04:05:08.262612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:08.263166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670f8e-8d25-4d9b-b159-2164ee77c97a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.263166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670f8e-8d25-4d9b-b159-2164ee77c97a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.263166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670f8e-8d25-4d9b-b159-2164ee77c97a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.263368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 338/655] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:08.263456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 318/656] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:08.264094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68670f8e-8d25-4d9b-b159-2164ee77c97a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.264551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.289544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.362965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a0f4e-0012-4136-a88e-92a65339b08e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.368312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68670f8e-8d25-4d9b-b159-2164ee77c97a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.398066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdbd3-55bb-4893-849f-108d7587a299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.398673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdbd3-55bb-4893-849f-108d7587a299 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.398953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdbd3-55bb-4893-849f-108d7587a299 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.399228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdbd3-55bb-4893-849f-108d7587a299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.401661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.402280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.402554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.402817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.413537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.414962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:08.429150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:08.430312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:08.431209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:08.431209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:08.431209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:08.431209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 319/657] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:08.431445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.468861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdbd3-55bb-4893-849f-108d7587a299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.469088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.470332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdbd3-55bb-4893-849f-108d7587a299 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.493958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.529914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91f83-4c24-4bcb-a9cd-eb6e357f258e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.562652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.563247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.563521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.563796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.564538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:08.564840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.566243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.568101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 339/658] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:08.569948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.570236 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.570505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.587890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 320/659] 10.222.0.27 () {56 vars in 1139 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:08.588068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:08.588576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.589063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:08.656238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 340/660] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:08.657074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.697444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.704982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c161b9c-ec16-4031-ad63-b556087ff00f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.715656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.749014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.749695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.750367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.750661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.759784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.761508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.761992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880d9b-8ca5-49e1-b808-30c564dbe549 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:08.773281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:08.774198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:08.775102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 321/661] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:08.775589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.798930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.799476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.799752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.800053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.800687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:08.800982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.802318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.819230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 341/662] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:08.819230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.887703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8f80c-e6b6-4a4a-8999-f22e53e03543 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.922301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.923148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.923427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.923695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:08.927420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53d933-dd5f-480c-8c8d-b73fb8db9f03 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:08.935058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:08.936535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:08.941245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:08.950958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:08.952060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:08.953355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:08.953355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:08.953355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:08.953355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 322/663] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:08.953355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:08.964092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:08.965928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:08.966542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:08.966853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:08.967156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.035138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.036645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.051221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73603437-8e0f-4d02-8917-d0d1dedf4c54 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.084406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.084997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.085272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.085536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.086213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.086510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.087899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.099396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 323/664] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.100052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.137549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 342/665] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:09.138231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.151703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.164826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.198182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce5bc-3ea6-4e2e-b8a5-b4605d2b2755 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.230828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.231450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.231726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.232025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.235541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afebf-3edd-4c46-b4e5-806ae8a22db0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.238373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.239792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:09.250680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:09.251582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 324/666] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:09.253022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.272391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.273056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.273367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.273666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.283491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:09.288341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:09.289388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 343/667] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:09.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.352002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8bd70-faf9-4973-8b34-502b10a40c8b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.359781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.377798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.385785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.386398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.386659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.386923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.387545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.387844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.389217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.390065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697748ae-ad5b-425c-a9d2-3d6cd50b67ff None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.402066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 325/668] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.402859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.425312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.425930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.426244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.426554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.427323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=d1c891f90f1b4b508752dfebc1de3589) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.427704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.429185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.434744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 344/669] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/role_assignments?user.id=d1c891f90f1b4b508752dfebc1de3589&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.435524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.513472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc7049-6481-4160-9f38-44e90a439684 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.553028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.554054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.554338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.554769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.562776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881aa93-3ef7-4cd7-8c6f-08110feb4055 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.567193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.568856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:09.586248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:09.587332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:09.588283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:09.588283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:09.588283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:09.588283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 326/670] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:09.589284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.608484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.609034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.609311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.609583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.610282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.610282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.612021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.615530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.627336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 345/671] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.628286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.638671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.705363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309bf15-6e91-4c1a-b3ef-a70d4d9b105c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.739667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.740834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.741117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.741387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.742042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.742344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.743697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.751798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 327/672] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.752634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.760161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436f251-8607-4927-942d-6b41eea10a67 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.796687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.797315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.797598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.797868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.807974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.809416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:09.821626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:09.822542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 346/673] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:09.832255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.866097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c84d-5694-4dc9-b28e-88113cacbcd0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.867674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.891145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:09.902198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.902812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.903394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.903394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.904004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.904306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.905680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.919286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 328/674] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.920038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:09.942721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710d6f6-5ef7-46e9-87ad-b6794a024e83 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:09.978132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:09.979015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:09.979292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:09.979561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:09.980312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=424b048ef3454b8597a80c0f605b4c64) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:09.980615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:09.982462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:09.988466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 347/675] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/role_assignments?user.id=424b048ef3454b8597a80c0f605b4c64&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:09.989254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.047271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdafbd5-ed98-40cf-a4be-d118a6948b45 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.095222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.096163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.096543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.096910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.109238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.110985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.124646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfe888-0b3f-4d0c-a897-02b94990a771 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:10.128575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:10.129556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:10.130460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:10.130460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:10.130460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:10.130460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 329/676] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:10.135791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.151727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:10.152999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:10.171748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.173465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.173912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.174331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.175186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:10.175651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.177242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.191891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 348/677] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:10.194140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.251238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7007d-fd0f-4c21-b3bb-d7ae35e1a263 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.293960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.295275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.295563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.295835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.304319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.305831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:10.321115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:10.322078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:10.322967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:10.323429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830353c3-8144-48bf-a76a-6b4c0c727b27 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.326677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 330/678] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:10.327687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.361176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.362238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.362527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.362801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.363766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:10.364109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.366176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.380171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 349/679] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:10.381164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.430335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:10.436787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:10.468992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7d43-b3a8-433a-a105-90b600242a0a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.514279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf06a-0e36-4eef-80a7-6e169bae0429 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.515342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.516055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.516394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.516751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.517651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=1afa3489655343c699a658472da4646b) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:10.518277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.519877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.532473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 331/680] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/role_assignments?user.id=1afa3489655343c699a658472da4646b&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:10.532473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.585244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.585848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.586123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.586396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.587098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:10.587403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.588873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.611747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 350/681] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:10.621047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.718957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42e514-1923-49e6-888c-aa2bf1bc684f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.759538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.760629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.761110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.761628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.770220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.772051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.774186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:10.785727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:10.787562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:10.788791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:10.791116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 332/682] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:10.796390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:10.820523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5ae59-9a73-41d0-b8fa-271d58dc4685 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.824257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:10.867658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.868448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.868825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.869714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.870554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=07cf20962b404013898ef0d093cf53ed) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:10.870963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.873045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:10.883423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 351/683] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/role_assignments?user.id=07cf20962b404013898ef0d093cf53ed&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:10.932094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8d57b-8834-49ef-9410-d7764fa48367 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:10.973733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:10.974830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:10.975117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:10.975392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:10.976226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:10.976529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:10.978107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:11.000750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 333/684] 10.222.0.27 () {56 vars in 1135 bytes} [Sat Oct 1 04:05:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:11.006168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:11.118131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd7c8-f12e-4cf8-869f-12a7f21da670 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:11.154652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:11.155270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:11.155553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:11.155829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:11.190479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:11.232825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:11.234391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:11.345517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 352/685] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:11.350794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:11.412561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:11.473924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca83b3-73db-4e11-ba63-5e2c9fd079f8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:11.524306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:11.524895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:11.525175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:11.525450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:11.541077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:11.542531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:11.563188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:11.564227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:11.565123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:11.565123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:11.565123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:11.569225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 334/686] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:11.574476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:11.657587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:11.710666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb493-8c51-4d37-99d8-f44e494c59fc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:11.755897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:11.756575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:11.756856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:11.757129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:11.757782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:11.758083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:11.759435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b04c5-78dd-457c-8bce-0084b4849b1c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:11.776168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 353/687] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:11.777473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:11.956961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6227c-f582-4ffd-a9fb-ebe9156a51e0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:11.967049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:11.987810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61897679-f1fd-4daf-92ac-e62a03c6768b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:11.988137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61897679-f1fd-4daf-92ac-e62a03c6768b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:11.988404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61897679-f1fd-4daf-92ac-e62a03c6768b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:11.990408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 354/688] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:11.995546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844629c-93dd-4f2a-ac1a-b677cf27c1af None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:11.995834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844629c-93dd-4f2a-ac1a-b677cf27c1af None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:11.996147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844629c-93dd-4f2a-ac1a-b677cf27c1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.016730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:12.017426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:12.017706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:12.018230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.032259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f844629c-93dd-4f2a-ac1a-b677cf27c1af None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:12.033388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f844629c-93dd-4f2a-ac1a-b677cf27c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:12.036101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:12.038227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:12.051713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:12.052720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:12.053619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 335/689] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:12.059517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:12.166875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f410-583b-4010-a418-242f003e2a34 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:12.204436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:12.205248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:12.205540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:12.205817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.206527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:12.206837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:12.208443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:12.222196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 336/690] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:12.229571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:12.261040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 355/691] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:12.272331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:12.379653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4ff0-3168-4afe-bcef-0621ffe37857 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:12.432919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:12.433543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:12.433820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:12.434087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.434808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=afc96390262a4509ba740d0708ae26aa) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:12.435111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:12.436562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d7199-94f7-4655-b173-5116f422bf47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:12.449402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 337/692] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:12 2022] GET /identity/v3/role_assignments?user.id=afc96390262a4509ba740d0708ae26aa&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:12.478724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd571-631e-497f-a2ab-93e0c24ebf4f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:12.479366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd571-631e-497f-a2ab-93e0c24ebf4f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:12.479833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd571-631e-497f-a2ab-93e0c24ebf4f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.481693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 356/693] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:12.487231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:12.487523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:12.487801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.512598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:12.514158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:12.606564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 338/694] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 01 04:05:12.676642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd571-631e-497f-a2ab-93e0c24ebf4f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:12.739041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:12.792171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd571-631e-497f-a2ab-93e0c24ebf4f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:12.826916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:12.827984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:12.828208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:12.832040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:12.832040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:12.832040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:12.841881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:12.842913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:12.843759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 357/695] 10.222.0.27 () {56 vars in 1129 bytes} [Sat Oct 1 04:05:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:12.849828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:12.876131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:12.952668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:12.964894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da718e-2f3a-4625-bfcf-0e6815020a2b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:13.013054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:13.014189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.015115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.015693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.016613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:13.017327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:13.019513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:13.026557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 339/696] 10.222.0.27 () {56 vars in 1124 bytes} [Sat Oct 1 04:05:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:13.031849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:13.086654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e12c4-0734-431c-91ec-14f88ad17252 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:13.109637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:13.133551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:13.134537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.135079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.135494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.137385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:13.148716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:13.155218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b71a0-5316-401e-a8ef-8fd0ca671763 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:13.155836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:13.156930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:13.157783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:13.163996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 358/697] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:13.166755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:13.202392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:13.203427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.204095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.204567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.206166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:13.206692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:13.208299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:13.215821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 340/698] 10.222.0.27 () {56 vars in 1124 bytes} [Sat Oct 1 04:05:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:13.294912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a521-8479-4667-bc32-01b3e3a9d191 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:13.338853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:13.339469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.339804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.340108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.340808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:13.341112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:13.342469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5bab8-be0b-41c1-8de0-c2e0d4ad628f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:13.355395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 359/699] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:13.361285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:13.507525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed1bb-edb1-4697-9895-3ad65c8b77b7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:13.536174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5cac-d49e-4a96-9859-dcfde196aec5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.536524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5cac-d49e-4a96-9859-dcfde196aec5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.537286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5cac-d49e-4a96-9859-dcfde196aec5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.538751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 360/700] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:13.544433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.544987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.545576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.550990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:13.551637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.551915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.552240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.566304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:13.566830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:13.568654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:13.569025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:13.584379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:13.585430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:13.586390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:13.586390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:13.586390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:13.586390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 341/701] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:13.593341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:13.597291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:13.628296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:13.690110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 361/702] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:05:13.766268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2651e04-87c0-4d3c-9942-fe066ac0629e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:13.815479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:13.816152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.816432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.816708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.817381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:13.817687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:13.819820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9a093-41a0-406f-b5e4-a2957d371cf8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:13.843568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 342/703] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:13.849848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:13.951633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931676b-dfd9-4348-bb70-a5cb1960d8ea None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.951975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931676b-dfd9-4348-bb70-a5cb1960d8ea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.952217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931676b-dfd9-4348-bb70-a5cb1960d8ea None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:13.953885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 343/704] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:13.973763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:13.974122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:13.974391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.001379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:14.002581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:14.037178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05091e7-db95-45d0-8bec-39a132f4a06f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.075281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.075917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.076233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.076507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.084503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.085882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.095201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:14.097619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:14.098568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:14.100135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:14.101378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 344/706] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:05:14.107971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 362/706] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:05:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:14.107971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.108453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.162734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.285914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa4afe-fbf7-45df-8284-8c49d5028f19 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.298372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3574240-d4e8-43b0-b2fa-e80638b42633 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.351123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702da18-8319-4d70-a53f-343789840985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.352344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702da18-8319-4d70-a53f-343789840985 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.353227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702da18-8319-4d70-a53f-343789840985 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.354122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702da18-8319-4d70-a53f-343789840985 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.355412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702da18-8319-4d70-a53f-343789840985 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:14.356194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702da18-8319-4d70-a53f-343789840985 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.357612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.358402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.359858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.360296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.361122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702da18-8319-4d70-a53f-343789840985 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.377844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.379599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.389366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 363/707] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:14.390592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702da18-8319-4d70-a53f-343789840985 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:14.403619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:14.404844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:14.406007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:14.406007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:14.406007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:14.406007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 345/708] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:14.406007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.455853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.496479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.514510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702da18-8319-4d70-a53f-343789840985 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.533480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c0b38-58ad-40d9-ba68-fae8cc248a8c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.555005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.555575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.555851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.556142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] PATH_INFO: `/v3/services/network` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.556873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.558536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:14.568558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:14.569611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:14.570514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 364/709] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:14.571359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.584809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.585725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.586709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.587201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.677931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0cee-1d73-4abc-91ed-46e0ea05cb38 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.684525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.687167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.720393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.721097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.721265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.721534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.722169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:14.722467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.723802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.738727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 365/710] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:14.739859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.754850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.758703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.815033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 346/711] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:14.816376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.861369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833296d5-0e3b-4223-bdce-1142deef09a1 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.901181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.902199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.902643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.903061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.903835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] RBAC: Adding query filter params (name=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:14.904310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.906582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.912489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 366/712] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:14.913575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:14.925681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d85219-8442-4e9d-8a95-057fc6ac829c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:14.963051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:14.964066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:14.964606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:14.965076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:14.965959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:14.967775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:14.987879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:14.993665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 347/713] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:05:14 2022] POST /identity/v3/users => generated 254 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:14.994792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:15.008636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:15.056609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426ad79-c92f-4606-810d-3a9b4ccd8a38 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.117729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f20b2-b18f-4eac-86d8-40aa91128814 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.120335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:15.121690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.121690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.121690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.143524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:15.145031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:15.158109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:15.159113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.159620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.160134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.161096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] RBAC: Adding query filter params (type=network) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:15.162130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:15.163688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76cf81-3cbe-4694-80d6-29a5d3fad672 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:15.167377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:15.168380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:15.169287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:15.169287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:15.169287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:15.176377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 367/715] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:15.176663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 348/715] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:15.178442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:15.317560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f53e20-d1d6-4fd9-aab6-3341fd08d84b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.356865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:15.359840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58571b7-a0ce-40bd-8b26-92a697c11ef2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.360378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58571b7-a0ce-40bd-8b26-92a697c11ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.360806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58571b7-a0ce-40bd-8b26-92a697c11ef2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.362716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 349/716] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:15.372558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:15.373486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.373911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.374329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.375208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:15.375664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:15.376692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.376977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.377253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.377753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:15.397151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 368/717] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:15.405438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:15.405617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:15.406833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:15.496231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:15.509184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 350/718] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:05:15.543161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6fa7-6229-4f88-8398-9f98a0d727b0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.579440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:15.580107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.580383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.580654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.587545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:15.588997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:15.600626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:15.601565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:15.602777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 369/719] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:15.607394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:15.745499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272713-5b2c-4d8d-893b-70d004509c89 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.793654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:15.794631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.795130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.795622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.796545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:15.797078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:15.798711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:15.812872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:15.815983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 351/720] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:15.821504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:15.868680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:15.912712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:15.934466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7d0c7-cdac-40ea-8950-d2370ac08d08 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.959138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc546-50cd-4194-8ed2-9f1ae62d72c9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:15.975006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:15.976175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:15.976654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:15.977133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:15.988759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:15.995278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:15.996285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:15.997133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:16.003964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 370/721] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:16.006912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:16.017462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:16.018336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.018610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.018988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.019720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=424b048ef3454b8597a80c0f605b4c64) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:16.020062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:16.021699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bdc115-02b9-418f-b8bb-9c08ad589e80 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:16.036903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 352/722] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:15 2022] GET /identity/v3/role_assignments?user.id=424b048ef3454b8597a80c0f605b4c64&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:16.038601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09d0c-0412-4bbe-854c-4584b5c040bc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.038882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09d0c-0412-4bbe-854c-4584b5c040bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.039150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09d0c-0412-4bbe-854c-4584b5c040bc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.045045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 353/723] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:16.046450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.046740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.047014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.071326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:16.072932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:16.167035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866b3d-4c1f-4671-838c-a5b1398c0d81 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:16.187870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:16.199117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 354/724] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:05:16.239543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:16.240746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.241029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.241364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.242067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:16.242426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:16.243821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:16.254661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 371/725] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:16.259359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:16.320737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:16.400699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e477a9-c946-4c79-a1be-175419863d8e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:16.435041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:16.435673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.435962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.436239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.446840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:16.448294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:16.462809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:16.463873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:16.464834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:16.464834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:16.464834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:16.464834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 355/726] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:16.469737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:16.582117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:16.602659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751fed3-4bf8-487e-a72c-64e8c98d0a8c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:16.687378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:16.688041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.688326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.688607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.689277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:16.689580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:16.692702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:16.717818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 372/727] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:16.726378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:16.732319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:16.740217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63d1e1-9435-4f24-a45e-c44998353d3f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:16.792793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:16.807788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:16.808735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.809145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.809559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.810511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:16.813381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:16.843607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 356/728] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:16 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:16.909830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4277c-8222-4529-ae10-de3228655496 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:16.977553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:16.978457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:16.978877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:16.979286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:16.989828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:16.991557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:17.003884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:17.005163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:17.006306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:17.008624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 373/729] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:17.017171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:17.129017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d72ba0-50f4-46fb-a361-381ae90512f4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:17.169056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:17.169982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:17.170437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:17.170873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:17.171758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:17.172250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:17.173876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:17.194062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 357/730] 10.222.0.27 () {56 vars in 1135 bytes} [Sat Oct 1 04:05:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:17.199451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:17.290646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:17.307716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2c9ac-42ef-4521-be8a-46f689a27bfb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:17.342429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23854b12-27b6-45b7-a61d-995d38d632ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:17.343028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23854b12-27b6-45b7-a61d-995d38d632ec None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:17.343305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23854b12-27b6-45b7-a61d-995d38d632ec None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:17.343569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23854b12-27b6-45b7-a61d-995d38d632ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:17.426714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23854b12-27b6-45b7-a61d-995d38d632ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:17.429230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23854b12-27b6-45b7-a61d-995d38d632ec None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:17.553459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:17.567354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 374/731] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 01 04:05:17.568658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:17.601166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:17.677467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63625-f039-4e63-8abb-9d9515849904 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:17.677655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63625-f039-4e63-8abb-9d9515849904 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:17.677962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e63625-f039-4e63-8abb-9d9515849904 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:17.688053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 375/732] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:17.693867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:17.694154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:17.694428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:17.707982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da113-26bb-4b7e-a0fd-18278a9a2f36 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:17.737915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:17.739140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:17.756713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:17.757373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:17.757630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:17.757942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:17.775215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:17.776694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:17.792350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:17.793408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:17.794320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:17.794320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:17.794320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:17.794320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 358/733] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:17.799214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:17.972400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:18.007639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 376/734] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:05:18.044607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d5fa-c9d5-4294-af8c-173d09756965 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:18.091758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:18.092391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.092667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.092942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.093633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:18.093931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:18.095338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf230b8c-9ac4-463f-86b4-7f779ff9e448 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:18.114031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 359/735] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:18.120123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:18.149483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6172e3-dd60-4efa-a1d9-8ff2fda89672 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.149788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6172e3-dd60-4efa-a1d9-8ff2fda89672 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.150029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6172e3-dd60-4efa-a1d9-8ff2fda89672 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.152413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 360/736] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:18.157780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.158061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.158364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.192094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:18.193867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:18.269765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac42ec-6328-4e40-939b-6f3d6241288f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:18.289583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 361/737] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 01 04:05:18.296275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:18.312509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:18.313170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.313444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.313712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.323257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:18.324812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:18.346766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:18.347834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:18.349635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:18.350081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:18.350157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 377/738] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:18.355257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:18.448023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:18.522103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4adc-7c3e-4dd7-8709-20ef525b50bf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:18.539897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe747f6-e751-47ae-8420-51ae0316947d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:18.577897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:18.578648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.578926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.579193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.579884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:18.580214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:18.581897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:18.595276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 378/739] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:18.596675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:18.597558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.598053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.598528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.599487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:18.601365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:18.605220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:18.633482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 362/740] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:18 2022] POST /identity/v3/services => generated 240 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:18.636202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:18.646364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:18.762415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c5dc-dc4d-4dbf-9fbf-cf7977531c21 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:18.791973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8b27-d2ab-4304-8e82-201c07463aed None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:18.826810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:18.842209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:18.842850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.843126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.843400 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.844214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=afc96390262a4509ba740d0708ae26aa) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:18.844528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:18.846278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050b09a-2cbf-4ad3-8c5b-dc6e5514dc20 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:18.859970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 379/741] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:18 2022] GET /identity/v3/role_assignments?user.id=afc96390262a4509ba740d0708ae26aa&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:18.859970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d6618-cc57-42ae-a9bc-92871088b020 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.859970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d6618-cc57-42ae-a9bc-92871088b020 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.859970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d6618-cc57-42ae-a9bc-92871088b020 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.864958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 380/742] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:18.868524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:18.869191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.869471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.869743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.878130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:18.878464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:18.878675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:18.885178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:18.892371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:18.893661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:18.894507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:18.897775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 363/743] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:18.908007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:18.908007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:18.909010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.011884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 381/744] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:19.045922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207507-2a12-453d-bd4f-504f62eda892 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.087081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.087702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.088004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.088285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.088962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:19.089268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:19.090634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:19.100691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 364/745] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:19.106554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.141463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:19.216405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49292ef-70b3-4d68-8547-c5821ffd1a1f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.258048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.258694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.258975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.259245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.270495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:19.272501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:19.284916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:19.309884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:19.310913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:19.311818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:19.311818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:19.311818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:19.314929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 382/746] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:19.318973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.362867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:19.453004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:19.463634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5066d-7975-47e9-b7ae-1e429fac5cbf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.475700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be74fe-3b64-40c9-ae4f-e20bc132df77 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.501332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.502319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.502801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.503303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.516178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.516789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.517063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.517330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.518237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:19.518535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:19.519874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:19.520674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:19.525908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:19.526838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:19.527770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:19.530511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 365/747] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:19.538919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.544769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 383/748] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:19.545849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.655962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:19.661069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d43ff-fec6-48dd-8977-fab195dff199 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.702837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.703954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.704441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.704967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.705832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:19.706332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:19.708145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:19.718599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 366/749] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:19.724606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.792396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5d67-523c-4fcf-80db-d000ca5f6725 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.842742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.843395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.843674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.843960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.861137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:19.862850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:19.890058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:19.891072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:19.892080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 384/750] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:19.898144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:19.902490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:19.941111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08350c-d08d-440e-af2a-2832643a7865 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:19.980842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:19.981743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:19.982026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:19.982724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:19.997152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:19.998602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-744fff14-4522-4784-be1c-6088395903d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:20.017783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:20.019489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:20.021977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:20.021977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:20.021977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:20.021977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 367/751] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:20.021977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba0044-0b63-4896-9747-55ce927732b4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.021977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba0044-0b63-4896-9747-55ce927732b4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.022637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba0044-0b63-4896-9747-55ce927732b4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.027353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 368/752] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:20.029956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d186781-56b2-4e93-995f-4622d0e5a7de None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.032467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba0044-0b63-4896-9747-55ce927732b4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.049887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.069956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.071070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.071961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.072669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.073660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:20.074159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.075837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c16ea8-a41a-4f04-8346-1bd67a6671e3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.096074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 385/753] 10.222.0.27 () {56 vars in 1149 bytes} [Sat Oct 1 04:05:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:20.097527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1563-7427-471c-be71-b4c411380572 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.098031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1563-7427-471c-be71-b4c411380572 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.098450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1563-7427-471c-be71-b4c411380572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.120830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-639d1563-7427-471c-be71-b4c411380572 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:20.122209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-639d1563-7427-471c-be71-b4c411380572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:20.156803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba0044-0b63-4896-9747-55ce927732b4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.193564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.199623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.200673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.201099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.201563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.202370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:20.202817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.204349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.212486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 386/754] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:20.213287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1563-7427-471c-be71-b4c411380572 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.218098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 369/755] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:20.223615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.355129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.388607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1563-7427-471c-be71-b4c411380572 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.408842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff84f6-71ae-4b18-a850-ad39156f1ca0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.430061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.431009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.431500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.432005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.459421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.460486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.461014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.461487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.469517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.471431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:20.495906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:20.496907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:20.497872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:20.503632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 370/756] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:20.509871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.542117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.558539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.560954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.642164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545321b-77c7-46b2-88f5-fe2a22003f08 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.666018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 387/757] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:05:20.666883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.673997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.680201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.681164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.681661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.682137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.683338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:20.683856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.685631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.704581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 371/758] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:20.705720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.761362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.773783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed723b02-7a57-4a3f-8c93-fa3a11b29d5f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.810187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.810830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.811112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.811386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.812002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.813366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.821961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09134ed7-ee12-46f2-a3b8-dfb2f1921bca None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:20.822467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:20.823459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:20.824341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:20.829260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 388/759] 10.222.0.27 () {56 vars in 1129 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:20.829391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.874226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.875228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.875744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.876416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.887701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.889565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:20.905738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:20.906749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:20.907684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:20.907684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:20.907684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:20.909806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 372/760] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:20.910847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:20.937806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0349e1-0468-426a-abb7-646a28c70769 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:20.956298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:20.973794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:20.974433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:20.974714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:20.974988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:20.986718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:20.988206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:21.003473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:21.004552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:21.005527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:21.005527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:21.005527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:21.005527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 389/761] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:21.006225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.015126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.023775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32db059-cfb0-49a1-8621-faa4aeac0626 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.060171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.061121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.061640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.062167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.063009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.063539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.065135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.070466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 373/762] 10.222.0.27 () {56 vars in 1124 bytes} [Sat Oct 1 04:05:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.071579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.118709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb5f1e-146c-4421-b196-d8a0b785d88e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.155494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.156162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.156446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.156716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.157397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.157709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.159112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.173584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 390/763] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.174460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.189872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771e1d-9599-4c56-9369-8ad5a7dffca5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.198135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.229056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.230093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.230588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.231070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.231927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.232458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.234065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.243606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.247241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 374/764] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.248406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.285273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcdffb-83e6-45af-8cd3-9571b7f8af71 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.324042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.324645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.324922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.325189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.325812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.326110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.327459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.333672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 391/765] 10.222.0.27 () {56 vars in 1124 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.334458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.366246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57e94d-00fd-4acb-8e1e-7f4ac7114392 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.402144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.402779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.403055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.403318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.409776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.411748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-14db48c6-173c-432c-8b1c-183f7c31891b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:21.422665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:21.423569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:21.424518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 375/766] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:21.425092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a711e4-5ff0-45a3-9fbc-0f0c0b57e864 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.425162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a711e4-5ff0-45a3-9fbc-0f0c0b57e864 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.425452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a711e4-5ff0-45a3-9fbc-0f0c0b57e864 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.426799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 376/767] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:21.427854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a711e4-5ff0-45a3-9fbc-0f0c0b57e864 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.445952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f89b-bcbf-4445-b9fb-ef545524e86c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.454894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.474060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.479950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.480571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.480847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.481115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.487758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.489261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-271fe4e5-fc7c-4cfc-abb9-5e19c8218c9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:21.500124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:21.501193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:21.502331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:21.506019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 392/768] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:21.507326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4dc5-adf4-4db8-b71c-dbe6ebcd67b5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.507683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4dc5-adf4-4db8-b71c-dbe6ebcd67b5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.507976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4dc5-adf4-4db8-b71c-dbe6ebcd67b5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.509248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 393/769] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:21.509934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4dc5-adf4-4db8-b71c-dbe6ebcd67b5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.532037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a711e4-5ff0-45a3-9fbc-0f0c0b57e864 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.564701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.565239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.565511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.565776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.566461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] RBAC: Adding query filter params (interface=public, service_id=c882bf6b14504410abf837a3aecbf43b, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.566764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.568444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07867f-2aea-44b6-9c21-5a94c306290a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.575266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 377/770] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/endpoints?service_id=c882bf6b14504410abf837a3aecbf43b&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.576410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.576692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.576961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.594376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:21.595546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:21.616702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4dc5-adf4-4db8-b71c-dbe6ebcd67b5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.649625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.650225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.650500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.650767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.651446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.651743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.653188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84614eae-c1ba-494d-acf3-a5710fadc88a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.660680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 378/771] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:21.662151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.665773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 394/772] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.666856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.667140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.667432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.685287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:21.686847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:21.688605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.738744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.767961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 395/773] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:21.767961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.781919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6e57-2cae-4041-bae6-1a99984aa8f0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.826149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.828777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.829167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.829546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.830349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:21.830755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.832448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.849962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 379/774] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.849962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.909246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6893-f4ea-4ebb-969c-9b62ed3b0ea2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.934871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:21.949531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.950144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.950424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.950891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:21.951292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:21.952672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:21.956516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9efa8f-ab67-4569-a4eb-697cbd9104a7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:21.960051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 396/775] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:21.960051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:21.997324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:21.998293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:21.998761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:21.999172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.000108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=146928ec042742ed8db41b6af73036cc) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:22.000588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.002421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.009706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 380/776] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:21 2022] GET /identity/v3/role_assignments?user.id=146928ec042742ed8db41b6af73036cc&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:22.010813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.028112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:22.113115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729599-ce94-454a-9c49-e9fec2dbf00e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.158793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.159464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.159568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.159853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/424b048ef3454b8597a80c0f605b4c64/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.162441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=424b048ef3454b8597a80c0f605b4c64, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.163902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.182149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 397/777] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:21 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/424b048ef3454b8597a80c0f605b4c64/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:22.183323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.184224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba9cf-c9a6-4d35-bb20-8e4608d11127 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.234722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.235806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.236336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.236803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.252127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:22.257857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:22.258900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:22.259774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:22.262995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 381/778] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:22.265681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.271758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:22.396380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931f7d0-5fdf-47ee-9a77-91a4ca256e90 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.398081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf7f7-980e-48bd-b956-bef41999f040 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.399507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:22.442435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.443185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.443526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.443799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.444554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:22.444854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.446236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.452269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.452924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.453206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.453478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] PATH_INFO: `/v3/services/network` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.454675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.456396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.459630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 382/779] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:22.466383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:22.478588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:22.479687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:22.481287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 398/780] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:22.485813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.583555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:22.629179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5a872-8c64-41b9-8b9f-78dd14e1583e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.669570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.670119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.670394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.670660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.682775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.684995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.695245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2faaa-e63d-47d6-ba55-32487920bc1f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:22.702373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:22.703351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:22.704312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:22.704312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:22.704312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:22.704312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 383/781] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:22.709225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.763414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.764404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.764890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.765381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.766237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:22.766752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.768590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.776546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 399/782] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:22.784056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.849883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:22.909078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11912e0-8a9e-4637-be12-62da430c827f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.934404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7084ea-5829-40b7-9683-04d2006d7df4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:22.952036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:22.972273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.973945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.974434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.974905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.975767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] RBAC: Adding query filter params (type=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:22.976289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.978223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:22.983919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 400/783] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:22.989518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:22.992008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:22.994888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:22.995413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:22.995900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:22.996801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:22.998112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:22.999752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.024261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 384/784] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:23.027736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:23.188259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccc64b-2e0a-4ffb-9422-cca42ea3883d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:23.200259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:23.203149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e984-9bfc-4754-8a70-8cc120e081f0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:23.259357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:23.259989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:23.260274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:23.260550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:23.261255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] RBAC: Adding query filter params (interface=public, service_id=387a25acaffa498eb1ba1d01c0b21f92, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:23.261564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:23.262929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.274729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:23.275370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:23.275651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:23.275926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:23.281888 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 401/785] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:22 2022] GET /identity/v3/endpoints?service_id=387a25acaffa498eb1ba1d01c0b21f92&interface=public®ion_id=RegionOne => generated 194 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:23.283358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:23.284815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.287720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:23.297522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:23.298473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:23.299459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 385/786] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:23.304856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:23.374023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:23.486826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ca261-1814-40bf-9429-e88adaa009ac None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:23.495760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3280b76-3b44-4386-80bc-b76d107b0382 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:23.544820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:23.545449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:23.545732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:23.546008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:23.546739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:23.547049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:23.548529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.567984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 386/787] 10.222.0.27 () {56 vars in 1135 bytes} [Sat Oct 1 04:05:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:23.570576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:23.571202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:23.571482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:23.571759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:23.572409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:23.573764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.582860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 402/788] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:23 2022] GET /identity/v3/services => generated 772 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:23.584058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:23.687565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:23.695675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23658-b9c4-4bc2-ae78-2821fcffcb55 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:23.734358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:23.735361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:23.735874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:23.736365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:23.747357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:23.749173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:23.765442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:23.766532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:23.767714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:23.767714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:23.767714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:23.769807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 387/789] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:23.775892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:23.831208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:23.939472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7724a-4c2e-4922-92eb-ac5141d86853 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:23.980447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:23.981071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:23.981347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:23.981617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:23.982260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:23.982616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:23.984142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:23.998514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 403/790] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:24.003870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:24.147583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0acd-f206-4bc6-a042-d0e8929553ed None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:24.190933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:24.191581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.191858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.192682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.201351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:24.202791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:24.219839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:24.220822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:24.221737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 388/791] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:24.227375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:24.338151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:24.359334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d587de-febb-4d0b-9c1a-6c2e0b202a49 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:24.403477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:24.404110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.404387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.404653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.405343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:24.405697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:24.407161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f5426-ea25-44d6-b762-23e82f30c628 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:24.419790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 404/792] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:24.425535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:24.438712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:24.566093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b34d-bc8a-4e9d-a904-2f3cefba0498 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:24.574448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d4869-8d9e-4b5a-967d-5b05a9ff0763 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.574783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d4869-8d9e-4b5a-967d-5b05a9ff0763 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.575062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d4869-8d9e-4b5a-967d-5b05a9ff0763 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.576529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 405/793] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:24.581180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e37411-ea02-4ffb-b192-34818358b2b2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.581468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e37411-ea02-4ffb-b192-34818358b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.581749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e37411-ea02-4ffb-b192-34818358b2b2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.583350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 406/794] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:24.587990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708a14-371d-42b0-8ac1-0fdca269c8d4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.587990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708a14-371d-42b0-8ac1-0fdca269c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.587990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708a14-371d-42b0-8ac1-0fdca269c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.609239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-55708a14-371d-42b0-8ac1-0fdca269c8d4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:24.610354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55708a14-371d-42b0-8ac1-0fdca269c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:24.613805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f5611-0f10-4234-a4f9-464e422fdd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:24.615080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f5611-0f10-4234-a4f9-464e422fdd07 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.615428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f5611-0f10-4234-a4f9-464e422fdd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.615823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f5611-0f10-4234-a4f9-464e422fdd07 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/afc96390262a4509ba740d0708ae26aa/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.617880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f5611-0f10-4234-a4f9-464e422fdd07 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=afc96390262a4509ba740d0708ae26aa, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:24.619484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f5611-0f10-4234-a4f9-464e422fdd07 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:24.638535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 389/795] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:24 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/afc96390262a4509ba740d0708ae26aa/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:24.639760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.640062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.641437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.661473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:24.662768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:24.702708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 407/796] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:24.704129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b5c7-0c3e-437e-a05d-d15a75393376 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.704457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b5c7-0c3e-437e-a05d-d15a75393376 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.704724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b5c7-0c3e-437e-a05d-d15a75393376 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.710792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 408/797] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:24.712910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:24.713190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:24.713516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:24.746874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:24.750702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:24.769769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:24.785046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 390/798] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:24.843513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 409/799] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:25.009639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.092565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.096217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.149780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a9ac8-7816-40c3-9e80-affb918ad64c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.191152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.192165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.192590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.193006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.207858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:25.212767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:25.213904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 391/800] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:25.215042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.229084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eaaf6-1c88-46e1-8264-d73120a9651f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.275983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.277101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.277914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.278337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.279066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.281140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:25.286570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:25.293099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:25.294340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 01 04:05:25.295425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:25.298910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 410/801] 10.222.0.27 () {56 vars in 1129 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:25.300247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.334170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417620e-6644-4355-a768-0566ef5848ec None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.370132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.370976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.371626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.372040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.379284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.383580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:25.389515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:25.390529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:25.391546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 392/802] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:25.393521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.422016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ef5d-e04f-491f-9dff-6f3f414e1921 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.461676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.462801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.463230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.464038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.465201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:25.465655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.467175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:25.477638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 411/803] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:25.478714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.522197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187010-a82f-482a-bfc8-aea2c27ae7b2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.545316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.572192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.573259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.573547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.573826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.574466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:25.574774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.576941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:25.583646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 393/804] 10.222.0.27 () {56 vars in 1124 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:25.584679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.599890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e038f2-c5ca-404e-9413-2a229a3e85d8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.635709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.644530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.645329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.645657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.645944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.646611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:25.647177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.649143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:25.661216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 412/805] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:25.662317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.720804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090cc8f-1e5f-467b-b7e9-d58603949e4f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.767104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.768080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.768348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.768624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.772504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027a1e-3c4f-46d0-b439-7bb115013bc9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.782832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.784695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:25.805455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:25.806457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:25.807367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:25.807367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:25.807367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:25.811545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 394/806] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:25.812713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.816772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.818258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.818757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.819237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.820102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:25.820604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.822185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:25.828225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 413/807] 10.222.0.27 () {56 vars in 1124 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:25.829393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:25.853989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.900200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:25.931875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32bf9f-b0de-4335-bfc7-652526245302 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.962758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4f986-1397-46f0-8fa3-b44fabe76d34 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:25.972025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:25.972908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:25.973991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:25.974504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:25.985589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:25.987359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:26.002504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:26.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:26.004694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:26.004694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:26.004694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:26.009793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 395/808] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:26.009793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.012740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.013607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.014085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.014578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.015496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:26.016068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.017955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.031691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 414/809] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:26.032906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.135462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:26.139710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de183528-771a-4abc-8c07-4a46bc695550 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.153721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d50bc5-63b7-4774-accd-18abde825140 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.158360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:26.178865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.179685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.180092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.180487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.181221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:26.181623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.183068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.195783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.196643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.197301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.197800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.198671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.200048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 415/810] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:26.200529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.200925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.232034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 396/811] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:26.234094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.328433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e819ba6-d5b4-42fc-b7ec-0fdacfb41dd2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.364594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c6db-056d-4465-9cc0-7717dacde3fd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.377112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.378405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.379257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.379872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.391710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.393768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.404211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.404774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.405052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.405358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:26.412724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:26.413730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:26.414671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:26.416948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.417799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 416/812] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:26.422583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.424121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:26.425213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:26.436902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:26.437959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:26.438900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:26.452621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 397/813] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:26.460780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.477246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:26.568037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bfc28-4b21-4fd3-b667-957a162ef8fa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.606615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.607575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.608154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.608602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.609989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:26.610505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.612863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8070c-5c61-4220-8556-c6152925d52a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.636718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 417/814] 10.222.0.27 () {56 vars in 1149 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:26.637940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a6b0-d216-401e-8ab5-b5bee905647a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.638290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a6b0-d216-401e-8ab5-b5bee905647a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.638635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a6b0-d216-401e-8ab5-b5bee905647a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.640070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 418/815] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:26.644601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a6b0-d216-401e-8ab5-b5bee905647a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.645371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0975295-2726-490b-b730-83cf136a48c1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.687179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.688662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.688942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.689211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.689949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:26.690255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.691685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979680-ed04-4053-8275-4dcc94562784 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.717731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 398/816] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:26.719395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.719897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.720413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.745641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:26.747919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:26.762064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:26.773060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a6b0-d216-401e-8ab5-b5bee905647a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:26.822766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:26.826389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:26.826389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:26.826389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:26.833562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:26.836727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:26.838235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:26.856772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 399/817] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:26.862522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:26.863488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:26.864479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:26.864479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:26.864479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:26.864479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 419/818] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:26.864479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:26.867794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.032616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0570b-15e4-4438-b671-9204b32ce6ea None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.071023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311be8f-98f8-408d-aaf0-31edb6c31db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.071684 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311be8f-98f8-408d-aaf0-31edb6c31db7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.071989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311be8f-98f8-408d-aaf0-31edb6c31db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.072393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311be8f-98f8-408d-aaf0-31edb6c31db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.093590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.102767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599064c7-bc28-4308-ae31-49c14e23c840 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.146844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311be8f-98f8-408d-aaf0-31edb6c31db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.149267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311be8f-98f8-408d-aaf0-31edb6c31db7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.193258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.193881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.194153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.194418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.195055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:27.195349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.197370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.215610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 400/819] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:27.215610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.265797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.277972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 420/820] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:05:27.279730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e95d-8a38-4674-a27b-2d445acfb6e4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.280038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e95d-8a38-4674-a27b-2d445acfb6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.280313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e95d-8a38-4674-a27b-2d445acfb6e4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.284049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 421/821] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:27.284049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e95d-8a38-4674-a27b-2d445acfb6e4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.327905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282117-00c9-4de1-9511-d6815e00f692 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.334258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.363347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.364068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.364342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.364617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.365624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.367384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:27.378079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:27.379176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:27.381015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 401/822] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:27.381854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.400460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e95d-8a38-4674-a27b-2d445acfb6e4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.441635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.442319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.442600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.442872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.450969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.453299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-12113888-e1ed-4f95-9c54-fc0e04a67858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:27.466198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:27.467131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:27.468052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:27.472063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 422/823] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:27.474043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.474327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.474596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.488223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167388-aa49-4f36-b07b-ea15e0923ab7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.492498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:27.493678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:27.500547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.526939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.527699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.528061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.528401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.538865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.540481 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:27.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:27.556898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:27.558015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:27.558015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:27.558015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:27.558284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 402/824] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:27.559128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.573236 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 423/825] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:27.573931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.610673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.685064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2af33-aef7-4d7b-8c2f-d54819318cc1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.700606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f6309-5ced-49ac-acc4-bb1bc4a845df None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.729650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.730865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.731757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.732407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.733318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] RBAC: Adding query filter params (name=network) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:27.733888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.736033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.736948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.737653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.738030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.738435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.739757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:27.740181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.741738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.743176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 403/826] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:27.744935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.761532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 424/827] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:27.761532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.787317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.865826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:27.872586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6fbd4-d69a-4be8-89f8-7b9781a948b3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.893668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e81ad-735b-4d1e-b5ae-45370ab9e719 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:27.909368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.909979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.910255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.911057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.911685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] RBAC: Adding query filter params (type=network) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:27.912015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.913368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.918210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 425/828] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:27.918958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:27.942537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:27.943405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:27.944314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:27.944777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:27.945867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:27.946516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:27.948692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:27.965432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 404/829] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:27.965432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.024379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cca22-b4d7-43b9-a0e9-71d176349818 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.054179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:28.062921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.063597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.064055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.064339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/146928ec042742ed8db41b6af73036cc/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.071318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e18d9-ee0e-4624-8374-d605f697e394 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.081237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=146928ec042742ed8db41b6af73036cc, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.083082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.096396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 426/830] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:27 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/146928ec042742ed8db41b6af73036cc/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:05:28.097293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.116118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.117605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:28.118418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.118911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.119530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.135109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:28.140951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:28.142502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:28.143549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:28.146839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 405/831] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:28.147983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.250512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273f1cc-e88e-4623-8d29-29448595f890 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.273101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c20a83-059b-440e-b748-8d0c68af60f2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.297720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.298471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.298847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.299244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.300156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.302146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.315510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.317194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.317194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.317194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.326388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 427/832] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:28.326558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.327541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.328298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:28.346045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:28.347216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:28.348369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:28.348845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 406/833] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:28.356757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.368852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:28.441060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:28.529273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5674-ddfb-4434-bf4e-c13600bc06ae None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.552729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250048-3f65-41f3-8b86-fe3e4a53c9eb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.573776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.574413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.574691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.574963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.575780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:28.576137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.577656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.588856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 428/834] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:28.594439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.598666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.599228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.599510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.599788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.600529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:28.600840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.602499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.616660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 407/835] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:28.623882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.698747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:28.721069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a3f76-5cf5-4dab-8d09-22c8bd4457fa None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.743790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9091350-a45e-4a48-a5d6-a4c4f9fbd583 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.747471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:28.758597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.759340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.759615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.759885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.771442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.772899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.783567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.784194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.784470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.784734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.785971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=424b048ef3454b8597a80c0f605b4c64) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:28.786278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.787672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612da9c-6bd1-453d-a014-f057a70fea11 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-49d3ce1d-5f69-4d55-890e-d867c2305811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:28.788505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:28.789444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:28.790352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:28.790352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:28.790352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:28.790352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 429/836] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:28.791005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b238f-33df-4dff-bf89-791b8811896d None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.791102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b238f-33df-4dff-bf89-791b8811896d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.791307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b238f-33df-4dff-bf89-791b8811896d None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.792678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 430/837] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:28.804248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 408/838] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/role_assignments?user.id=424b048ef3454b8597a80c0f605b4c64&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:28.804248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.804248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.804248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.804664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b238f-33df-4dff-bf89-791b8811896d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:28.831221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:28.832567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:28.933054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b238f-33df-4dff-bf89-791b8811896d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:28.940469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 409/839] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:28.973429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:28.974129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:28.974408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:28.974732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:28.975387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:28.975691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:28.977097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:28.990129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 431/840] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:28.995590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.175350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:29.212803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.221354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b442-4cd2-4d7f-84db-c142d40869a2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.255271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:29.264880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.265988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.266277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.266550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.277204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.279343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:29.295817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:29.296845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 01 04:05:29.297765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:29.298398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 410/841] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:29.305218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.333278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9a48-efcc-4d6b-905d-4f8981f0d15a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.376248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.376911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.377170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.378851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.378851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.379638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:29.391206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:29.392516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:29.393367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 432/842] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:29.398289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.425490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a7bb7-5b57-4153-abe2-4a52180f091d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.448106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:29.462748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.463566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.463876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.464303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.465074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:29.465469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.467249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:29.492033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 411/843] 10.222.0.27 () {56 vars in 1135 bytes} [Sat Oct 1 04:05:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:29.493071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.514615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:29.519599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbddfe-49ee-4c13-98a6-566802a7c0ea None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.559911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.560813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.561245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.561666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.562482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:29.562934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.565273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:29.575359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 433/844] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:29.576437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.599291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624de1f-a0d1-4447-8caf-4749d85815da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.633771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.634493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.634830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.635165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.682487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:29.692396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df6929-6b21-4171-b402-a35d3440f428 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.704902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.706357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:29.730294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.731229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.731713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.732226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.733258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:29.733713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.735334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:29.746184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 434/845] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:29.817852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 412/846] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:05:29.823592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:29.861313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:29.945969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4456-776b-496b-af6e-b84a57b2d1af None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:29.982449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:29.983419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:29.983905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:29.984471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:29.995831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:29.997641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:30.012527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:30.013539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:30.014445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:30.014445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:30.014445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:30.016552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 435/847] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:30.024540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:30.102697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:30.125513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4aafd2-d739-4bce-8287-21ed59c5ff42 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:30.160231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:30.161369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:30.161637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:30.161897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:30.162525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:30.162819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:30.164182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:30.175837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 413/848] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:30.181399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:30.264658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:30.284517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441feef8-b6ed-4081-9ade-661791eb9f5b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:30.320821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:30.321457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:30.321732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:30.322002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:30.328679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:30.330110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-87661546-86c4-40de-b8a8-2a2e3b7b9df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:30.341889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:30.342971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:30.344239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 436/849] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:30.349479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:30.457436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55785-ad54-4585-9d95-58a7355484af None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:30.492401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:30.493009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:30.493281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:30.493549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:30.494233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:30.494531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:30.495957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:30.503378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:30.507792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e93d0-515d-4d2b-9581-18b7d8a0432e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:30.508096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e93d0-515d-4d2b-9581-18b7d8a0432e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:30.508370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e93d0-515d-4d2b-9581-18b7d8a0432e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:30.509990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 437/850] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:30.510899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 414/851] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:30.515462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:30.515920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:30.515920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:30.519276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:30.539142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:30.540397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:30.625028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b3ae2-d402-41ff-a4e7-1d62165c8be8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:30.636083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 438/852] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:30.666693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:30.667492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:30.667880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:30.668311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:30.669117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=afc96390262a4509ba740d0708ae26aa) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:30.669514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:30.671005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:30.677928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 415/853] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:30 2022] GET /identity/v3/role_assignments?user.id=afc96390262a4509ba740d0708ae26aa&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:30.916869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:30.989237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.023974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263c43-6cd5-4dd2-81ac-a00587c5f090 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.059080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5fa13-f61f-4563-b874-c2b4901cf898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.059720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5fa13-f61f-4563-b874-c2b4901cf898 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.060021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5fa13-f61f-4563-b874-c2b4901cf898 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.060289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5fa13-f61f-4563-b874-c2b4901cf898 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.071479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5fa13-f61f-4563-b874-c2b4901cf898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-82c5fa13-f61f-4563-b874-c2b4901cf898 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:31.076302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:31.077494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:31.078731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 439/854] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:31.083606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.102448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e48aa-8ad6-47ef-aadf-493d1cd55a02 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.102733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e48aa-8ad6-47ef-aadf-493d1cd55a02 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.103011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e48aa-8ad6-47ef-aadf-493d1cd55a02 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.104635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 440/855] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:31.109528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.109809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.110082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.128149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:31.129896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:31.155639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.204437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 441/856] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:31.209344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23588594-9759-4bf7-9887-484861ab89b9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.246255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.247156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.247608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.248076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.248930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:31.249451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:31.251015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:31.263978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 416/857] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:31.265886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.334514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.377502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf68090-954f-45d2-8696-bd3ba4536b71 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.413349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.414283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.414769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.415210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.426591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:31.428265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:31.443689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:31.444746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:31.445653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:31.445653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:31.445653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:31.447473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 442/858] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:31.453254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.473253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.579159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164297-a81a-406c-89f3-ece62042c27e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.588211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bd168-8973-41c1-aa6f-3e174d51c959 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.594539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.618699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.629554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.630200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.630474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.630741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.631333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:31.632926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:31.634029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.634883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.635376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.635855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.636737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:31.637240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:31.638777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:31.643141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:31.644112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:31.649056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 443/859] 10.222.0.27 () {56 vars in 1132 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:31.656483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.661131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 417/860] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:31.666544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.787640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908edabd-9809-44de-83cc-a209ee2a5257 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.791443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b4fc-ea83-4b9b-b39f-eaaecc3c07ac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:31.831923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.832632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.832908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.833180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.833820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:31.834119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:31.835481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:31.839360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:31.840372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:31.840844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:31.841322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:31.844070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 444/861] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:31.846404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.855687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:31.857482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:31.870569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:31.871524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:31.872534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:31.874988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 418/862] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:31.881218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:31.901637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.936319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:31.977703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14405787-1c0e-441b-8c34-262243c2d6ca None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:32.011763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e657334-552f-4e5d-9916-3dba6fe1fcd6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:32.013278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:32.013965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.014165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.014436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.015061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:32.015364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:32.017107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea08522-17f2-4eb2-a4d7-5f2f6a4388ea None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:32.027111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 445/863] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:32.029347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b918-0000-4a7e-aa4d-f26f88d06069 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.029699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b918-0000-4a7e-aa4d-f26f88d06069 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.030071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b918-0000-4a7e-aa4d-f26f88d06069 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.036145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 446/864] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:32.038059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.038415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.038766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.058764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:32.060143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:32.061128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:32.061981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.062788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.063262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.065264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:32.065767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:32.067575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:32.102185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 419/865] 10.222.0.27 () {56 vars in 1149 bytes} [Sat Oct 1 04:05:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:32.109030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:32.147917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 447/866] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:32.229070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c37fc6-58bd-4ccc-9237-98eeec604884 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:32.231229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:32.266537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:32.267666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.268128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.268552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.337975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:32.339677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:32.416102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:32.452207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:32.457554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 420/867] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:05:32.458688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:32.460607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:32.541689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305841f-4766-472d-a58a-b4dc0c03a270 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:32.572709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a303f-c32f-41f0-b006-d2dddbd64944 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:32.584022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:32.585774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.586345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.586778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.587843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:32.590121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:32.610931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 448/868] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:32 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:32.622795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:32.623667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.624089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.624514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.637685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:32.639355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:32.657438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:32.658528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:32.659511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:32.659511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:32.659511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:32.659511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 421/869] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:32.666638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:32.777729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:32.785105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdd786-7720-4104-9f3c-210519ca165b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:32.829146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:32.829818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.830096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.830368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.831038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:32.831339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:32.833317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc47469-6517-4f3e-9554-6139ddc06896 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:32.847421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 449/870] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:32.854478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:32.910294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:32.939699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d75c14-afa8-4a1a-8641-61d762ffac69 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.939887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d75c14-afa8-4a1a-8641-61d762ffac69 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.940200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d75c14-afa8-4a1a-8641-61d762ffac69 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.941911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 450/871] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:32.947056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:32.947349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:32.947626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:32.968489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:32.969687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:32.970640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5472b6-7c05-4f05-a4bb-8cc42a6d255c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:33.019005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:33.020214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:33.020496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:33.020769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:33.028428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:33.029870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:33.042136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:33.043288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:33.044336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 422/872] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:33.050061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:33.051844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 451/873] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:33.154171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091c8d-75aa-4c23-be0e-e66fd5eb244d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:33.165673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:33.191641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:33.192586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:33.193091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:33.193558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:33.194431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:33.194936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:33.196749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:33.209720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 423/874] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:33.215885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:33.302003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:33.318138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dcf81-9012-495c-b688-ded4c977f347 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:33.326604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:33.362599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:33.363240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:33.364084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:33.364343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:33.365080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=146928ec042742ed8db41b6af73036cc) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:33.365384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:33.367580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:33.375171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 452/875] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:33 2022] GET /identity/v3/role_assignments?user.id=146928ec042742ed8db41b6af73036cc&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:33.454749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3768b68-23e4-4a52-a89e-7075e37c200f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:33.497969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:33.499011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:33.499487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:33.500020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:33.500807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:33.502375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:33.512816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:33.513927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:33.514781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:33.518133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 424/876] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:33.524491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:33.636334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d45bb-31cf-4526-9131-bdab028cbe0e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:33.673255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:33.673869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:33.674148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:33.674417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:33.675043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:33.675344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:33.676771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acc538-6336-43ea-b82e-aa61ab68d047 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:33.682643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 453/877] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:33.688078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:33.725801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:33.794792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600a2b-025c-47b9-aef4-45a59be928ac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:33.831099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02851934-3a02-4c30-8891-897b1594869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:33.831717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02851934-3a02-4c30-8891-897b1594869b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:33.832536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02851934-3a02-4c30-8891-897b1594869b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:33.832809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02851934-3a02-4c30-8891-897b1594869b None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:33.833435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02851934-3a02-4c30-8891-897b1594869b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:33.833730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02851934-3a02-4c30-8891-897b1594869b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:33.835091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02851934-3a02-4c30-8891-897b1594869b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:33.840090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 425/878] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:34.326695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440582f-e57e-4a90-80b5-6eab90239b0d None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:34.327065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440582f-e57e-4a90-80b5-6eab90239b0d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:34.327245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440582f-e57e-4a90-80b5-6eab90239b0d None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:34.328901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 454/879] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:34.334113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec527e-3a91-4329-8b74-da68a0831354 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:34.334550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec527e-3a91-4329-8b74-da68a0831354 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:34.334641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec527e-3a91-4329-8b74-da68a0831354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:34.352826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-96ec527e-3a91-4329-8b74-da68a0831354 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:34.354035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-96ec527e-3a91-4329-8b74-da68a0831354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:34.423589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 426/880] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:34.696270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440582f-e57e-4a90-80b5-6eab90239b0d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:34.713480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:34.813654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440582f-e57e-4a90-80b5-6eab90239b0d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:34.850818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72665226-43fc-402e-94f3-e4fbdc3e911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:34.851431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72665226-43fc-402e-94f3-e4fbdc3e911b None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:34.851706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72665226-43fc-402e-94f3-e4fbdc3e911b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:34.851994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72665226-43fc-402e-94f3-e4fbdc3e911b None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:34.852933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72665226-43fc-402e-94f3-e4fbdc3e911b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:34.854427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72665226-43fc-402e-94f3-e4fbdc3e911b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:34.871122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 455/881] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:34 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:34.908964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052fcef-6c39-4247-9952-0694af354c48 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:34.909281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052fcef-6c39-4247-9952-0694af354c48 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:34.909538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052fcef-6c39-4247-9952-0694af354c48 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:34.911729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 427/882] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:34.917586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:34.917884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:34.918144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:34.943153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:34.944422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:35.020153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:35.026929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 456/883] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:35.295586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052fcef-6c39-4247-9952-0694af354c48 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:35.324372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:35.402721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052fcef-6c39-4247-9952-0694af354c48 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:35.438348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:35.438981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:35.439256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:35.439523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:35.440127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:35.442017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:35.450998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:35.452055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:35.452911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 428/884] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:35.458661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:35.560684 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665e55-8ec4-4a22-8001-545865e8959d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:35.596544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:35.597155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:35.598107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:35.598387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:35.599008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:35.599304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:35.600669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:35.605955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 457/885] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:35.613053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:35.710317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:35.720003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbccf83-da01-4452-964c-8877294f0771 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:35.759333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:35.759961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:35.760255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:35.760524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:35.761143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:35.761442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:35.762792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8e27d-67b2-4f30-969c-e85ad4bcf8e5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:35.768343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 429/886] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:35.777041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:35.833155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b120ab9-4ec7-4393-b4d9-9c127d6c33ea None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:35.833476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b120ab9-4ec7-4393-b4d9-9c127d6c33ea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:35.833701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b120ab9-4ec7-4393-b4d9-9c127d6c33ea None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:35.835342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 430/887] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:35.840971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:35.841260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:35.841510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:35.857829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:35.864539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:35.865750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:35.906467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece8f4-fd2c-42f3-b51b-4bb054cb1abb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:35.943312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:35.944109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:35.944399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:35.944724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:35.945427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] RBAC: Adding query filter params (interface=public, service_id=c3f860868f574e2f8d8cd6ce15c45a10, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:35.945661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 431/888] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:35.948107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:35.949506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096241-1f74-49d7-935b-f07b7170edc2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:35.959825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 458/889] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:35 2022] GET /identity/v3/endpoints?service_id=c3f860868f574e2f8d8cd6ce15c45a10&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:35.961185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:36.051582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:36.067814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286ebdf-0f5e-48d3-9aca-26bd19407a99 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:36.104465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be1b75-0971-465f-a2ac-020fa306f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:36.105328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be1b75-0971-465f-a2ac-020fa306f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.105758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be1b75-0971-465f-a2ac-020fa306f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.106177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be1b75-0971-465f-a2ac-020fa306f5a7 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.106927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be1b75-0971-465f-a2ac-020fa306f5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:36.108471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be1b75-0971-465f-a2ac-020fa306f5a7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:36.114822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 432/890] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:35 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:05:36.116702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bf38-afe7-4712-879d-64e95d121392 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.117166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bf38-afe7-4712-879d-64e95d121392 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.117593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6bf38-afe7-4712-879d-64e95d121392 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.119383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 459/891] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:36.124857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.125136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.125411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.146300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:36.147524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:36.226055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 433/892] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:36.227355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bf38-afe7-4712-879d-64e95d121392 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:36.346605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6bf38-afe7-4712-879d-64e95d121392 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:36.374441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:36.384705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:36.385388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.385665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.385932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.396658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:36.401513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:36.402465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:36.403320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 460/893] 10.222.0.27 () {56 vars in 1120 bytes} [Sat Oct 1 04:05:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:36.408953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:36.492913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:36.498089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:36.515147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439f8f2-cf2a-490b-925d-b5cc008eaafd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:36.559852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499491ab-118d-4049-9337-287aa573697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:36.561062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499491ab-118d-4049-9337-287aa573697d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.561892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499491ab-118d-4049-9337-287aa573697d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.562347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499491ab-118d-4049-9337-287aa573697d None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.563239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499491ab-118d-4049-9337-287aa573697d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:36.563782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499491ab-118d-4049-9337-287aa573697d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:36.566207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499491ab-118d-4049-9337-287aa573697d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:36.577920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 434/894] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:05:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:36.584605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499491ab-118d-4049-9337-287aa573697d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:36.622599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7beed9-d4ad-4b23-9f60-3e4ff33aabb3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:36.664742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:36.665921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.666641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.667507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.668632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:36.670890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:36.695770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 461/895] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:36 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:36.725963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499491ab-118d-4049-9337-287aa573697d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:36.771824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:36.772499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.772825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.773100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.781129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:36.787133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:36.788616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:36.805321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:36.806349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:36.807253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:36.807253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:36.807253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:36.807253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 435/896] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:36.812984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:36.867081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:36.925409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8c1f-1615-4d33-9ad5-3be9d885d41b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:36.961569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:36.962190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:36.962465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:36.962737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:36.963485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:36.963791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:36.965190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:36.978181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 462/897] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:36.983805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.090743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06466b-9ea8-4719-8e49-4989671eefa8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:37.130462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:37.131488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.131993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.132518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.141166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:37.143120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bc0b2c81-1919-45e0-8ab3-5a95390794af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:37.154822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:37.155802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:37.156810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:37.159289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 436/898] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:05:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:37.169288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.224660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434d0a-9c14-4a11-b5d3-e9ea18cee731 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.225275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434d0a-9c14-4a11-b5d3-e9ea18cee731 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.225751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434d0a-9c14-4a11-b5d3-e9ea18cee731 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.227753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 437/899] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:37.232720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.233003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.233282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.251753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:37.252691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:37.277439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196be0-4eb0-4af7-8db7-d22a1628b5a9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:37.287212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:37.316187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:37.316800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.317078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.317349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.318085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:37.318422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:37.319805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:37.338259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 463/900] 10.222.0.27 () {56 vars in 1149 bytes} [Sat Oct 1 04:05:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:37.343020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:37.343740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.347509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 438/901] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:37.447723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0dcc-e2f6-464f-ad33-40b37c1ed516 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:37.483619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:37.484518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.484968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.485387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.518607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:37.558149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:37.559879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:37.615711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.669879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 464/902] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 01 04:05:37.675103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.747321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad025f2-637d-40ab-bc12-0cdb2b970292 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:37.750427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:37.795612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:37.795874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bf233-40c2-43ca-9709-e97f445ebd15 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:37.796683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.797107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.797781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.799376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:37.801022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:37.811995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:37.813172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:37.814262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:37.818038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 439/903] 10.222.0.27 () {56 vars in 1132 bytes} [Sat Oct 1 04:05:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:37.823872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.851755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:37.853039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.853804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.854692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.867559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:37.869564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:37.875608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:37.889014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:37.890016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:37.890924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:37.890924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:37.890924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:37.893544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 465/904] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:37.898822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:37.949236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350b5b0-0388-4272-adcd-145ec6a8e5aa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:37.986243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:37.987231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:37.987830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:37.989009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:37.989841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:37.990348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:37.992027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:37.997916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 440/905] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:38.004011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.017407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e4a4-487f-4d35-a71d-7a60bef610e2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.036004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:38.059001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.059827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.060276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.060546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.061185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:38.061483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.062887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.078343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 466/906] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:38.084611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.132939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764af55-7b10-4aea-a66e-8c631e3ec07e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.152598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:38.178408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.179803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.180376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.180816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.181855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:38.182326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.184602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.195795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 441/907] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:38.197371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.208094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af70c19-d1ed-4623-a40f-7c1bfb2fa491 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.253260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.254363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.254828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.255310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.264448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.266258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:38.281056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:38.282043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:38.282952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:38.285987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 467/908] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:38.291503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.320871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0739dfa-7b16-42fa-91e6-b1dd2759292d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.328816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:38.363954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.364571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.364842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.365105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.365792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] RBAC: Adding query filter params (interface=public, service_id=50697ecea5514fbca75f6c89bf59774f, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:38.366156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.367744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4955c9c-7a72-4b5c-8a3e-687d8cd71d1a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.372496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 442/909] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/endpoints?service_id=50697ecea5514fbca75f6c89bf59774f&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:38.373699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f4114-1b53-42ad-a9ea-300e84342a46 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.373982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f4114-1b53-42ad-a9ea-300e84342a46 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.374251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f4114-1b53-42ad-a9ea-300e84342a46 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.375422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 443/910] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:38.381191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123677-37e1-457f-8c07-885b390bd956 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.381470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123677-37e1-457f-8c07-885b390bd956 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.381743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123677-37e1-457f-8c07-885b390bd956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.399340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-da123677-37e1-457f-8c07-885b390bd956 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:38.400000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee2a04-4b30-4c54-8fa2-02c8dffb4c9b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.400533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-da123677-37e1-457f-8c07-885b390bd956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:38.430696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:38.435683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.436535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.436961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.437392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.438083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:38.439053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.439809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.456007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 468/911] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:38.456007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.478131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 444/912] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:38.478979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123677-37e1-457f-8c07-885b390bd956 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.589827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123677-37e1-457f-8c07-885b390bd956 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.594342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:38.600781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058a30a-2e29-43c1-a3c0-cf270c07d08d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.638008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.638622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.638870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.639311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.639311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.639744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.640592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.641093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.641198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.641913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.643502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] RBAC: Adding query filter params (role.id=333c08e0c9e74ef986e47f70a936b34f, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=146928ec042742ed8db41b6af73036cc) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:38.644094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.646146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.652238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 469/913] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:05:38.657204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 445/914] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/role_assignments?user.id=146928ec042742ed8db41b6af73036cc&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=333c08e0c9e74ef986e47f70a936b34f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:38.752389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.880272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a9910-0ea6-4d08-9ee2-57e90e8f2fd2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:38.922169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:38.922801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:38.923078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:38.923346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:38.923922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:38.925385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-096548a2-1042-4c3b-87b4-3e345b2dac37 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:38.934629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:38.935635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:38.936565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 470/915] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:38.941945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:38.983971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:39.059037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553eb0e-1b6b-42af-a14d-bd3db802dc95 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:39.074356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21ae80-69a3-4f1b-8166-73a7ddaf5c5d None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.074698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21ae80-69a3-4f1b-8166-73a7ddaf5c5d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.074917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21ae80-69a3-4f1b-8166-73a7ddaf5c5d None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.076455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 471/916] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:39.082650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.082932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.083202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.103361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:39.104057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:39.104606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.105084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.105279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:39.105793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.106699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:39.107196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:39.108996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:39.114768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 446/917] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:39.122700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:39.124646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:39.184280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 472/918] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:39.241088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:39.248548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0390-8e29-4319-a95d-0f69a4134c53 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:39.284264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:39.285438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.285712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.285978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.286651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:39.286953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:39.288328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:39.293725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 447/919] 10.222.0.27 () {56 vars in 1114 bytes} [Sat Oct 1 04:05:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:39.301910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:39.405532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261127f-62ec-4374-b3c3-8a6080fa4b9e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:39.443785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:39.444345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.444618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.444885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.445618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:39.446973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:39.470120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 473/920] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:39.493958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:39.618818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05278-59cf-45a3-96da-c1934d855e9e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:39.664260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:39.665610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.665892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.666162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.666747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:39.668850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:39.682017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:39.683059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:39.683908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 448/921] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:39.688986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:39.704759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:39.814065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3fcc5-f238-48e1-b9b3-31df7eb6b5ba None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:39.857854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:39.858797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:39.859312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:39.859792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:39.860650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:39.861155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:39.863277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:39.868903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 474/922] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:39.876981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:39.894397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:39.982096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee490c1e-4625-4ebc-a3d3-65215a9db136 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:40.017884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:40.018555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:40.018837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:40.019172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:40.019805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:40.020131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:40.021502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:40.031891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 449/923] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:40.033243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:40.114445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:40.140653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8fa78-7923-4a11-a1b0-974dbecf1e74 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:40.179695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:40.180337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:40.180619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:40.180895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:40.181595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] RBAC: Adding query filter params (interface=public, service_id=3cebed249765482a8ee28e9fee093fde, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:40.181903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:40.183255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d1aab-c143-4a1c-a523-98cb43a099a4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:40.188737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 475/924] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:40 2022] GET /identity/v3/endpoints?service_id=3cebed249765482a8ee28e9fee093fde&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:40.194871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:40.281616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:40.299886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25be0-7c6b-4617-8ee3-1353f4c4e47a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:40.334188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dfd67-ea6d-42b3-872e-cc052b089556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:40.334844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dfd67-ea6d-42b3-872e-cc052b089556 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:40.335123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dfd67-ea6d-42b3-872e-cc052b089556 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:40.335389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dfd67-ea6d-42b3-872e-cc052b089556 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:40.336010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dfd67-ea6d-42b3-872e-cc052b089556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:40.337363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dfd67-ea6d-42b3-872e-cc052b089556 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:40.343503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 450/925] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:40 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:05:41.009601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8e3fb-e231-4b7f-89a1-f0c8eaaf805e None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.010128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8e3fb-e231-4b7f-89a1-f0c8eaaf805e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.010583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8e3fb-e231-4b7f-89a1-f0c8eaaf805e None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.012391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 476/926] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:41.018183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.019557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.025017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.043909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:41.045472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:41.048997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492a86d-d84f-4837-b829-f29b18b2b393 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.049444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492a86d-d84f-4837-b829-f29b18b2b393 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.049521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492a86d-d84f-4837-b829-f29b18b2b393 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.051106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 477/927] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:41.056189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.056462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.056735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.077886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:41.079162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:41.115574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 451/928] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:41.153333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 478/929] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:41.386959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.429710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.478748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:41.507582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:41.511453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83a24e-2237-4756-88da-e42f1b21d187 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:41.546738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c55cf-e546-4243-b0f1-21197a964bfb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:41.556608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:41.557692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.557967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.558234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.558815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:41.560864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:41.572893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:41.573876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:41.574787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 452/930] 10.222.0.27 () {56 vars in 1132 bytes} [Sat Oct 1 04:05:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:41.582097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.597829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:41.597829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.597829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.597829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.607742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:41.613505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:41.614451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:41.615313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:41.619794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 479/931] 10.222.0.27 () {56 vars in 1120 bytes} [Sat Oct 1 04:05:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:41.620655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.700792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a9ee-5a3f-4de0-8e50-c1d86f4b47d4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:41.735681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:41.736400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.736674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.736944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.737629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:41.738010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:41.739899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:41.743260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26ba72-2ee3-4321-87f9-efc166ceb84c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:41.749671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 453/932] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:41.752605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.757730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:41.785071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:41.795760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051740f-9728-417d-9869-649b30062d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:41.796638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051740f-9728-417d-9869-649b30062d68 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.797087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051740f-9728-417d-9869-649b30062d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.797500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051740f-9728-417d-9869-649b30062d68 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.798297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051740f-9728-417d-9869-649b30062d68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:41.798739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051740f-9728-417d-9869-649b30062d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:41.801198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051740f-9728-417d-9869-649b30062d68 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:41.810878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 480/933] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:05:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:41.816633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051740f-9728-417d-9869-649b30062d68 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.872843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb212d-30b6-4304-aba2-7d7081bfb4f6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:41.907565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:41.908591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.908897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.909170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.910355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:41.910652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:41.912020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5331c-501e-409e-acfd-0025ce9a0d21 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:41.916740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 454/934] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:41.917867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611d0ad-d0f4-447f-9cf3-696a52e0a01b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.918143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611d0ad-d0f4-447f-9cf3-696a52e0a01b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.918409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611d0ad-d0f4-447f-9cf3-696a52e0a01b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.919964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 455/935] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:41.922412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611d0ad-d0f4-447f-9cf3-696a52e0a01b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:41.937596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051740f-9728-417d-9869-649b30062d68 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:41.977742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:41.978305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:41.979083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:41.979357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:41.992189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:41.992751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:41.994165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-3b33da79-4913-4225-bd91-183a4a7adaf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:42.009526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:42.010598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:42.011546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:42.011546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:42.011546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:42.011546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 481/936] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:42.012384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.012384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.012644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.031955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:42.033133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:42.045397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611d0ad-d0f4-447f-9cf3-696a52e0a01b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.072281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:42.080806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.082204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.082806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.083502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.085111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.109031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 456/937] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:42.110254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.120257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 482/938] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:42.238896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62726b-d6fe-4200-81de-8a3ab9d9936a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.261806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:42.278628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.279741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.280256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.280905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.281568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:42.281872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.283283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.301038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 457/939] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:42.309928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.402258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.422629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e60abd-2a27-48d1-8576-dda94060e772 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.462653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.463370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.463662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.463957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.473601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.475158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:42.490666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:42.491693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:42.492677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 483/940] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:05:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:42.498716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.536700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:42.544912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368045c-3b2b-4353-8998-2fb0780f7781 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.589420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.590039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.590311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.590584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.591468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.592918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.595478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING keystone.server.flask.common [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 01 04:05:42.613996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.sql.core [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 01 04:05:42.613996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 01 04:05:42.613996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [parameters: {'id': 'e440eeb2b89f493f9960a5d1a5a19318', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 01 04:05:42.613996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 01 04:05:42.617493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d3f5-f986-4ae1-b323-5f6fe5337db7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c1f17777-e969-4abd-a9fc-64818658f519 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e440eeb2b89f493f9960a5d1a5a19318.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e440eeb2b89f493f9960a5d1a5a19318. Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 04:05:42.630565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 01 04:05:42.631451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application yield resource Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.rollback() Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.force_reraise() Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise self.value Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application session.commit() Oct 01 04:05:42.632507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._prepare_impl() Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.flush() Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._flush(objects) Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application compat.raise_( Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application flush_context.execute() Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 04:05:42.633449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rec.execute(self) Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 01 04:05:42.634359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 04:05:42.635172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [parameters: {'id': 'e440eeb2b89f493f9960a5d1a5a19318', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.637652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:42.640279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e440eeb2b89f493f9960a5d1a5a19318. Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 458/941] 10.222.0.27 () {60 vars in 1140 bytes} [Sat Oct 1 04:05:42 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc10b-ae04-4b58-bc01-f8140e9b3751 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.643129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc10b-ae04-4b58-bc01-f8140e9b3751 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.646780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc10b-ae04-4b58-bc01-f8140e9b3751 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.646780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 459/942] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:42.646780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cc10b-ae04-4b58-bc01-f8140e9b3751 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.665825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.666431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.666719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.666989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.667904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:42.668129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.669440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66e5da-1f24-4ab5-bb5a-68af863dd9d5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.681158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:42.693162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 484/943] 10.222.0.27 () {56 vars in 1149 bytes} [Sat Oct 1 04:05:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:42.694456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.694749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.695026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.714694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:42.715885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:42.752091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cc10b-ae04-4b58-bc01-f8140e9b3751 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.785174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 485/944] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:42.786195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.798240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.798988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.799437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.799808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.810636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.812450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.820266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:42.835100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:42.836215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:42.837346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:42.844061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 460/945] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:42.845347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:42.924251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45d82-7457-4d41-9721-4b92bac366f7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.962107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:42.962750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:42.963030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:42.963297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:42.968893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:42.976701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:42.977735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e25c4-78de-4d2a-921f-6b7dcb87e6d7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:42.978141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:42.996273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:42.997278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:42.998190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:42.998190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:42.998190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:42.998190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 486/946] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:43.003187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.023745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.024620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.025040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.025482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.026335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:43.026790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.028463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.052220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 461/947] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:43.069140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.083652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:43.121107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e9d36-9f02-4e6a-8221-10e7190942a2 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.158962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.160368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.160748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.161114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.161870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:43.162273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.163747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.181773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 487/948] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:43.183085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.188473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c54f-e70d-4726-9b93-ab80e8fcb77e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.227236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.228204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.228650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.229105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.229889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.231498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:43.241971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:43.243284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:43.244351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:43.246809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 462/949] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:43.252806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.278017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:43.300714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f6d5-0933-459d-9d3b-123003aa3fe3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.338255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:43.345147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.345921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.346291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.346678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.353995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.355525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:43.368568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:43.369676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:43.370788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:43.371528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 488/950] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:43.377092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.377799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b64b10-5cdf-4e38-9eb6-1e0a8c4184d0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.436352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.437687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.438066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.438438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.439358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:43.439665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.441840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.449385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 463/951] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:43.455171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.489718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1257-690c-4d63-96d1-bd811c47cf88 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.530108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.530634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.530909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.531179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.531866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:43.532195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.533607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.551566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 489/952] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:43.552549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.559033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:43.576892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25e949-a911-47d8-ab39-93f82a6effbf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.606998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:43.617790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.619133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.619655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.620130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.620899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:43.621382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.623785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.630812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 464/953] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:43.640121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:43.663000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f9246-3208-4997-9734-f30945dbb8df None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.698797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef182a-fe6b-446c-86cf-0c0309e04e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.699277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef182a-fe6b-446c-86cf-0c0309e04e20 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.699650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef182a-fe6b-446c-86cf-0c0309e04e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.700048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef182a-fe6b-446c-86cf-0c0309e04e20 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/146928ec042742ed8db41b6af73036cc/roles/333c08e0c9e74ef986e47f70a936b34f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.702535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef182a-fe6b-446c-86cf-0c0309e04e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=146928ec042742ed8db41b6af73036cc, role_id=333c08e0c9e74ef986e47f70a936b34f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.704172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef182a-fe6b-446c-86cf-0c0309e04e20 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.720019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 490/954] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:05:43 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/146928ec042742ed8db41b6af73036cc/roles/333c08e0c9e74ef986e47f70a936b34f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:05:43.763455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973db8a-f4d5-404b-9d37-691784660f5b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:43.803653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7384bf-4be8-4ce9-b5f4-f58643d0bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:43.804785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7384bf-4be8-4ce9-b5f4-f58643d0bc2a None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:43.805216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7384bf-4be8-4ce9-b5f4-f58643d0bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:43.805668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7384bf-4be8-4ce9-b5f4-f58643d0bc2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:43.806543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7384bf-4be8-4ce9-b5f4-f58643d0bc2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:43.808296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7384bf-4be8-4ce9-b5f4-f58643d0bc2a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:43.849115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 465/955] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:44.429525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc62cfa-5e31-4bc8-9d99-0a7eb16d5eee None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:44.430047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc62cfa-5e31-4bc8-9d99-0a7eb16d5eee None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:44.430134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc62cfa-5e31-4bc8-9d99-0a7eb16d5eee None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:44.431764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 491/956] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:44.437084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:44.437529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:44.437814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:44.445908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:44.458859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:44.460583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:44.538804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 466/957] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:44.814393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc62cfa-5e31-4bc8-9d99-0a7eb16d5eee None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:44.925346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc62cfa-5e31-4bc8-9d99-0a7eb16d5eee None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:44.939342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:44.962386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:44.963481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:44.964211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:44.964945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] PATH_INFO: `/v3/services/compute` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:44.965520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:44.966873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:44.975759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:44.976891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:44.977819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 492/958] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:44.985359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:45.090016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49a676-a3bd-41e6-88ae-0e874d959951 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:45.119453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:45.125962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:45.127008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:45.127281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:45.127547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:45.128781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:45.129080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:45.130435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ca62-f4a6-4d16-a840-aa10a6c92382 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:45.135626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 467/959] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:45.145046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:45.252005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed50ec-b6fe-4b68-8095-ec00a0fcacec None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:45.289404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:45.290005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:45.290280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:45.290546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:45.291163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:45.291458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:45.292826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58801e9c-c46a-4096-8b74-694fc4e0fb44 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:45.297621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 493/960] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:45.366054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de51be-e62d-411c-b041-3561b5dc6fd9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:45.366362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de51be-e62d-411c-b041-3561b5dc6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:45.366538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de51be-e62d-411c-b041-3561b5dc6fd9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:45.367976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 468/961] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:45.373763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:45.374162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:45.374523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:45.394802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:45.396136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:45.434203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:45.469646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 494/962] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:45.744749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de51be-e62d-411c-b041-3561b5dc6fd9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:45.860147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de51be-e62d-411c-b041-3561b5dc6fd9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:45.896550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:45.897504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:45.897975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:45.898439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:45.899251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:45.900999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:45.919674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.sql.core [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 01 04:05:45.919674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 01 04:05:45.919674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [parameters: {'user_id': '08e6308703744f45a2e14c9a1f98ce0e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 01 04:05:45.919674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a57e36f5-b94a-4daa-8b98-5d2e3c85139a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Oct 01 04:05:45.927800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 04:05:45.928989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application yield resource Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.rollback() Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.force_reraise() Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise self.value Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application session.commit() Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 01 04:05:45.930221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._prepare_impl() Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.flush() Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._flush(objects) Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application compat.raise_( Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application flush_context.execute() Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rec.execute(self) Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 01 04:05:45.931319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 01 04:05:45.932278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 01 04:05:45.933244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [parameters: {'user_id': '08e6308703744f45a2e14c9a1f98ce0e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:45.934103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 01 04:05:45.935068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 01 04:05:45.936217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 01 04:05:45.936217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 01 04:05:45.936217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 01 04:05:45.936217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 01 04:05:45.936217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 01 04:05:45.936217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:45.938611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 469/963] 10.222.0.27 () {60 vars in 1131 bytes} [Sat Oct 1 04:05:45 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:45.945103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.053302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceab2c1-2ccb-4fc5-896c-40bae3726e56 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.061535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6351-e980-4cb2-abdb-4e1faf15e18f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.061872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6351-e980-4cb2-abdb-4e1faf15e18f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.062073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6351-e980-4cb2-abdb-4e1faf15e18f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.067361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 470/964] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:46.072805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6696f-b153-4b2e-a0f9-c8ce0cf5f47e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.073040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6696f-b153-4b2e-a0f9-c8ce0cf5f47e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.073315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6696f-b153-4b2e-a0f9-c8ce0cf5f47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.093992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.094910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.095402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.095512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3fc6696f-b153-4b2e-a0f9-c8ce0cf5f47e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:46.095993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.096983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3fc6696f-b153-4b2e-a0f9-c8ce0cf5f47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:46.104550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:46.106211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:46.118273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:46.119482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 01 04:05:46.120715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:46.122954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 495/965] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:46.129263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.154053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:46.165293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:46.177015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 471/966] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:46.178918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a445cb-3204-499c-aab8-f10e5fa4eb18 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.179760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a445cb-3204-499c-aab8-f10e5fa4eb18 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.180251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a445cb-3204-499c-aab8-f10e5fa4eb18 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.182580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 472/967] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:46.187624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.187912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.188283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.211866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:46.213268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:46.243262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec48ae-7e12-4cb6-af2c-3558e5c1e1c8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.280701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.281400 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.281750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.282127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.282899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:46.283272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:46.284847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:46.319573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 473/968] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:46.323969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 496/969] 10.222.0.27 () {56 vars in 1101 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:46.452442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.565569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d6568-5571-4036-b4bd-bb9062c773d7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.583747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:46.585889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.609721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.609721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.609721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.609721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.624220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:46.630021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:46.631004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:46.631857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 474/970] 10.222.0.27 () {56 vars in 1120 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:46.637957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.690096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:46.703802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95779ab-c3f1-46c1-8c2e-78c526db6e9b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.737354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.737991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.738273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.738576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.739156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:46.740576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:46.749106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:46.750097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:46.750984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 497/971] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:46.754920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f508d6-73de-471d-ad15-de1b263a5251 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.756553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.793579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.794520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.795129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.795470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.796175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:46.796480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:46.798089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:46.807530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 475/972] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:46.813332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.855461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:46.863455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6e8b4-2f99-4709-b6d5-87d55a40f124 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.898071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.898711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.898998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.899274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.899904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:46.900240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:46.901593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:46.906463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 498/973] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:46.912422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:46.918416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f71c2-8949-4913-86bf-42f5c2e66df1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:46.931695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:46.956528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:46.957157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:46.957431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:46.957699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:46.968537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:46.969953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:46.984906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:46.985878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:46.986803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:46.986803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:46.986803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:46.986803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 476/974] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:46.992093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.023641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a3e5f-9ddd-4e3a-9dfa-7090178f0e92 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.062671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.063276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.063551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.063819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.064467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:47.064768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.066154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.071414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 499/975] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:47.076968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.092652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:47.105053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654186-7668-4d2f-9d37-4f2a24d86cff None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.140162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.140735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.141014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.141707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.142206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:47.142511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.144424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.162687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 477/976] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:47.164181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.167787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:47.189848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d75e1-f9a2-4f51-a9d4-b6f70dcc32de None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.225042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.225659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.225938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.226211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.226922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] RBAC: Adding query filter params (interface=admin, service_id=3cebed249765482a8ee28e9fee093fde, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:47.227232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.228628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.234172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 500/977] 10.222.0.27 () {56 vars in 1249 bytes} [Sat Oct 1 04:05:47 2022] GET /identity/v3/endpoints?service_id=3cebed249765482a8ee28e9fee093fde&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:47.240722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.271645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b6fb-d732-4420-9f65-2b80f2c34b89 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.308096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.309071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.309545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.310022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.317910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.319599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:47.332155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:47.333135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:47.334092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 478/978] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:05:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:47.338762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.351652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:47.353006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf88f0-84c2-4335-8b94-8075d17c9b61 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.389726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a06c7-c9ed-4279-9aa1-4170ffebd614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.390784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a06c7-c9ed-4279-9aa1-4170ffebd614 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.391517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a06c7-c9ed-4279-9aa1-4170ffebd614 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.391787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a06c7-c9ed-4279-9aa1-4170ffebd614 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.392497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a06c7-c9ed-4279-9aa1-4170ffebd614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.393890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a06c7-c9ed-4279-9aa1-4170ffebd614 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.401019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 501/979] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:47 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:05:47.465620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6f46f-a6ee-4a60-81a6-079be9eb00e9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.502254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.503425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.503711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.504009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.504757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:47.505065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.506526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.512948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf801b-47d4-4e8e-8d96-40296123a51f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.513270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf801b-47d4-4e8e-8d96-40296123a51f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.513503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf801b-47d4-4e8e-8d96-40296123a51f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.515014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 502/980] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:47.521485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.521782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.522040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.528292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 479/981] 10.222.0.27 () {56 vars in 1149 bytes} [Sat Oct 1 04:05:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:47.534054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.541783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:47.542951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:47.545359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:47.613667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:47.628932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 503/982] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:47.653306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c33d-739f-4ca0-9f45-7e68fd07eb2a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:47.688926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:47.689545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:47.689822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:47.690094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:47.757087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:47.758553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:47.830565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:47.864683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 480/983] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 01 04:05:47.870211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.908118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:47.981063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ab814-9d47-4124-bee8-e2418f9dd86b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:48.016437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037cecf-a12b-46f9-aae6-7f87f80152c5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:48.020070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:48.020704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:48.020984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:48.021257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:48.028556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:48.033335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:48.035628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:48.051860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:48.052503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:48.052780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:48.053052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:48.053149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:48.054023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:48.059869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:48.059869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:48.059869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:48.060105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:48.060206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 504/984] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:48.060292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:48.060375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:48.073357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 481/985] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:47 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:48.174195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e94c7-8075-4482-96bf-59790bf8b994 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:48.217296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:48.217915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:48.218204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:48.218460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:48.219105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:48.219402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:48.220811 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:48.237509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 505/986] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:48.239074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:48.272137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:48.351018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da0884-e68d-41bf-9002-c7365ef43aa6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:48.385114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:48.385749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:48.386029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:48.386303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:48.393210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:48.394674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:48.406112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:48.407154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:48.408193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 482/987] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:48.413890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:48.461284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:48.515947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfe4bd-e99a-470d-817e-a36d6d188358 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:48.550369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:48.550972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:48.551244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:48.551509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:48.552525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:48.552828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:48.554230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f70f-3f5c-46e3-a451-755bce0d4037 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:48.566166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 506/988] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:48.571878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:48.663914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:48.676903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87cff7-02cb-43a0-92b8-3dab7abe0d5b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:48.709858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:48.710457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:48.710731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:48.710997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:48.711763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] RBAC: Adding query filter params (role.id=333c08e0c9e74ef986e47f70a936b34f, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=146928ec042742ed8db41b6af73036cc) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:48.712040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:48.713459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c03b0-3bab-4438-82ba-72cf297e34c1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:48.719284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 483/989] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:48 2022] GET /identity/v3/role_assignments?user.id=146928ec042742ed8db41b6af73036cc&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=333c08e0c9e74ef986e47f70a936b34f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:49.568813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122d24-1e0a-4924-b136-0d24b7c6ee8a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:49.569359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122d24-1e0a-4924-b136-0d24b7c6ee8a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:49.569359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122d24-1e0a-4924-b136-0d24b7c6ee8a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:49.570819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 507/990] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:49.575920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:49.576351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:49.576542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:49.594954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:49.596172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:49.665742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 484/991] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:49.931965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29122d24-1e0a-4924-b136-0d24b7c6ee8a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.031977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29122d24-1e0a-4924-b136-0d24b7c6ee8a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:50.039310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:50.067390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:50.068046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.068327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.068599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.069176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:50.070519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:50.079223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:50.080478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 01 04:05:50.081456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:50.084003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 508/992] 10.222.0.27 () {56 vars in 1126 bytes} [Sat Oct 1 04:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:50.086572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.172379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:50.193304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bc61e-7612-4865-985b-6774ed82b7c4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:50.227365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:50.228039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.228319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.228589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.229305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:50.229610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:50.230961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c1a44-698f-493e-b4c2-c04a0ac77f04 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:50.241159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 485/993] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:50.242568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.264350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b798e-d79c-42d7-be8f-3060e470879d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.264658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b798e-d79c-42d7-be8f-3060e470879d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.264905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b798e-d79c-42d7-be8f-3060e470879d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.267130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 486/994] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:50.272985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.273276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.273776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.292351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:50.293796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:50.347133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938424c-fcc3-4e69-8a29-4092b8f80b0c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:50.369364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 487/995] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:50.381254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:50.381905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.382188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.382458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.383080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:50.383382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:50.384757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:50.394514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 509/996] 10.222.0.27 () {56 vars in 1122 bytes} [Sat Oct 1 04:05:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:50.396095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.475281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:50.505420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531daa-3713-400f-bfec-699ed6ab7cfe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:50.541447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:50.542106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.542389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.542659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.543320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:50.544704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:50.567966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 488/997] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:50.637444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.675872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:50.745519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52230cfe-16cd-4fc2-b7ab-2a7b52153663 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:50.788858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:50.789907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.790413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.790887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.791718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:50.793399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-9d4ba128-7d5d-4b34-94c2-e53cd7394b68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:50.803864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:50.804961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:50.805813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:50.808779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 510/998] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:50.814632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.895140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3bfb-dd03-4555-bcbe-b69d8ba2473f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.895318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3bfb-dd03-4555-bcbe-b69d8ba2473f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.895590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3bfb-dd03-4555-bcbe-b69d8ba2473f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.897108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 511/999] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:50.901932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.902214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.902489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.922629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:50.923805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:50.924050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb80d1-01b1-473a-8d8b-e036a932004a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:50.958618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:50.959229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:50.959514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:50.959785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:50.960447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:50.960754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:50.962117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:50.964145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:50.973191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 489/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:50.974046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:50.997055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 512/1001] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:51.076752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1efa58-24f7-4dad-935f-a2078593b515 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:51.115147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:51.115766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:51.116076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:51.116351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:51.116976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:51.117280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:51.118648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:51.128974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 490/1002] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:51.130497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:51.155483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:51.234936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02a83-3f70-4b69-aef4-ba819f3d0e0d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:51.264830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:51.269630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:51.270252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:51.270532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:51.270805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:51.271508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] RBAC: Adding query filter params (interface=public, service_id=7cffe26df6a545208ac45a4d17f9394d, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:51.271818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:51.273209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:51.282825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 513/1003] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:51 2022] GET /identity/v3/endpoints?service_id=7cffe26df6a545208ac45a4d17f9394d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:51.285004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:51.341211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:51.381716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:51.387623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42190a-ad0e-4403-866c-e590431a16e3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:51.396683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd084609-33a2-481b-b07f-e89944f2c050 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:51.423017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:51.423674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:51.423970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:51.424252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] PATH_INFO: `/v3/services/image` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:51.424884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:51.426254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:51.432140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:51.432741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:51.433015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:51.433284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:51.433933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:51.435268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:51.435383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:51.436489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:51.437835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 491/1004] 10.222.0.27 () {56 vars in 1105 bytes} [Sat Oct 1 04:05:51 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:51.442821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:51.456969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 514/1005] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:51 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:05:51.565855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331016-60f4-403d-be00-8706fffffd5b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:51.594270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:51.603927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:51.604653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:51.604992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:51.605326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:51.606027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:51.606392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:51.607837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce604f-db65-4036-bf1b-5f86477225f3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:51.613743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 492/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:51.619806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:51.724580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6c580-b5fd-4601-bc76-193cff345be0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:51.756921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:51.757522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:51.757795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:51.758061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:51.758678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] RBAC: Adding query filter params (type=image) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:51.758976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:51.760348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de5c1c-f301-4ee4-a862-da5db5ffbdeb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:51.764940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 515/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:52.743026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d1ca-c214-4f39-86ee-5781974240a1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:52.743549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d1ca-c214-4f39-86ee-5781974240a1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:52.743549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d1ca-c214-4f39-86ee-5781974240a1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:52.744963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 493/1008] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:52.750135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:52.750511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:52.750683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:52.769292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:52.770467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:52.781022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:52.843829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 516/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:53.111704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d1ca-c214-4f39-86ee-5781974240a1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:53.219480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d1ca-c214-4f39-86ee-5781974240a1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:53.254446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c5469-f78b-4f26-b582-32c9f2b44339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:53.255112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c5469-f78b-4f26-b582-32c9f2b44339 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:53.255401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c5469-f78b-4f26-b582-32c9f2b44339 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:53.255671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c5469-f78b-4f26-b582-32c9f2b44339 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:53.256861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c5469-f78b-4f26-b582-32c9f2b44339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:53.258332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c5469-f78b-4f26-b582-32c9f2b44339 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:53.264002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 494/1010] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:53.266378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:53.365532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba94d0-aa14-47cf-847b-72d627b98bb4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:53.398842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa3e5d-90d0-4d25-99a0-70d19ae52fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:53.399452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3e5d-90d0-4d25-99a0-70d19ae52fd3 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:53.399731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3e5d-90d0-4d25-99a0-70d19ae52fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:53.400033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa3e5d-90d0-4d25-99a0-70d19ae52fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:53.400662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa3e5d-90d0-4d25-99a0-70d19ae52fd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:53.402078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa3e5d-90d0-4d25-99a0-70d19ae52fd3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:53.425217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:53.437273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 517/1011] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:53 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:53.622295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7daac-80ce-4643-83e7-fc9c709b9abc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:53.622683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7daac-80ce-4643-83e7-fc9c709b9abc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:53.622955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7daac-80ce-4643-83e7-fc9c709b9abc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:53.624604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 495/1012] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:53.630229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af70a-0948-43fa-a122-019d1196a7d8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:53.630513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af70a-0948-43fa-a122-019d1196a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:53.630787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af70a-0948-43fa-a122-019d1196a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:53.650614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5a0af70a-0948-43fa-a122-019d1196a7d8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:53.651792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5a0af70a-0948-43fa-a122-019d1196a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:53.722863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 518/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:53.911323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b89b9-5af9-4dd4-b98b-dd7c785b79e7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:53.911810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b89b9-5af9-4dd4-b98b-dd7c785b79e7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:53.911810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b89b9-5af9-4dd4-b98b-dd7c785b79e7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:53.913164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 496/1014] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:53.918691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:53.919090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:53.919252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:53.937818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:53.939028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:53.991200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b89b9-5af9-4dd4-b98b-dd7c785b79e7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:54.011634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 519/1015] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:54.054357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:54.097600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b89b9-5af9-4dd4-b98b-dd7c785b79e7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:54.133026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:54.133702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:54.133979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:54.134246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:54.134815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:54.136187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:54.145378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:54.146384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 01 04:05:54.147239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:54.151593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 497/1016] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:54.152420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:54.213290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:54.255435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64780ce4-fcfb-4379-bd17-dfd76c76705b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:54.277722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:54.289310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:54.289921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:54.290255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:54.290532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:54.291156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:54.291453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:54.292825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:54.302245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 520/1017] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:54.303077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:54.384628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbf1de-2dc4-4fa1-9175-eb5079059b49 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:54.405787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26458c-5d15-42e2-accf-e8da4765badb None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:54.411183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:54.423927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:54.424744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:54.425017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:54.425282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:54.425972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:54.427339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:54.430059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:54.444196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 498/1018] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:05:54 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:05:54.450514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:54.451145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:54.451423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:54.451694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:54.452375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:54.452686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:54.454123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b41f8-fe0e-4c96-8996-b1aa268195fa None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:54.460349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 521/1019] 10.222.0.27 () {56 vars in 1112 bytes} [Sat Oct 1 04:05:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:54.466303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:54.578424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166afd-a98d-405a-a5ee-6b027fb2df8f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:54.615974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7de38-754f-44ea-93da-00f86e7d46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:54.616590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7de38-754f-44ea-93da-00f86e7d46d6 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:54.616865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7de38-754f-44ea-93da-00f86e7d46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:54.617701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7de38-754f-44ea-93da-00f86e7d46d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:54.617819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7de38-754f-44ea-93da-00f86e7d46d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:54.619153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7de38-754f-44ea-93da-00f86e7d46d6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:54.640171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 499/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:05:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:55.693387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba235d3-6073-4de7-a2df-f6a2bfa33b20 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:55.693963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba235d3-6073-4de7-a2df-f6a2bfa33b20 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:55.693963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba235d3-6073-4de7-a2df-f6a2bfa33b20 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:55.695491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 522/1021] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:55.700702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:55.701124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:55.701290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:55.719038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:55.720262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:55.755826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:55.806756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 500/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:56.073027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba235d3-6073-4de7-a2df-f6a2bfa33b20 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:56.176151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba235d3-6073-4de7-a2df-f6a2bfa33b20 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:56.209858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d54b2e-348b-4b16-935e-ed4e6ecbced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:56.210482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54b2e-348b-4b16-935e-ed4e6ecbced3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:56.210757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54b2e-348b-4b16-935e-ed4e6ecbced3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:56.211022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54b2e-348b-4b16-935e-ed4e6ecbced3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:56.212134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54b2e-348b-4b16-935e-ed4e6ecbced3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:56.213539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54b2e-348b-4b16-935e-ed4e6ecbced3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:56.215239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 523/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:56.220768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:56.320133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f3fc-4b04-4759-9b6c-da2d97b8da5b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:56.354655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea6182-7203-4064-907f-2b814075c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:56.355189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea6182-7203-4064-907f-2b814075c716 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:56.355460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea6182-7203-4064-907f-2b814075c716 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:56.355723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea6182-7203-4064-907f-2b814075c716 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:56.356415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea6182-7203-4064-907f-2b814075c716 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:56.357829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea6182-7203-4064-907f-2b814075c716 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:56.387968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 501/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:05:56 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:05:56.619993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce68d1-7016-49ac-bf3a-5ada97c1e7b5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:56.619993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce68d1-7016-49ac-bf3a-5ada97c1e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:56.619993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce68d1-7016-49ac-bf3a-5ada97c1e7b5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:56.620617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 524/1025] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:56.625172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748446cc-7ecd-4031-b704-6d4f9fdf9cd0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:56.625531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748446cc-7ecd-4031-b704-6d4f9fdf9cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:56.625812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748446cc-7ecd-4031-b704-6d4f9fdf9cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:56.645463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-748446cc-7ecd-4031-b704-6d4f9fdf9cd0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:56.646930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-748446cc-7ecd-4031-b704-6d4f9fdf9cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:56.664796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:56.718263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 502/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:05:56.914496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109ea1-c09d-466d-993a-6bf29a9d7228 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:56.914978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109ea1-c09d-466d-993a-6bf29a9d7228 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:56.914978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109ea1-c09d-466d-993a-6bf29a9d7228 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:56.916357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 525/1027] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:56.921675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:56.922131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:56.922407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:56.942209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:56.943377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:56.986421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5109ea1-c09d-466d-993a-6bf29a9d7228 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.012773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 503/1028] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:57.041318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.092019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5109ea1-c09d-466d-993a-6bf29a9d7228 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.125891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.126565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.126843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.127672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.128287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.129692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:57.138566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:57.139579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:05:57.140582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:57.144245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 526/1029] 10.222.0.27 () {56 vars in 1105 bytes} [Sat Oct 1 04:05:56 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:57.146857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.228950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.248744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e129e4-ddf7-4866-b33d-042b1a908bd7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.283582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.284250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.284559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.284829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.285451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] RBAC: Adding query filter params (name=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:57.285746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.287107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.289103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.297307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 504/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:57.298114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.393925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fec5d-ee91-437f-ae84-484dfb0885d8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.407665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.410635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653b973-963b-4398-82ed-c6ccecfa5958 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.430069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.430703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.430984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.431255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.442083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:57.445637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.446455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:57.446854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:57.447786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:57.448691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 527/1031] 10.222.0.27 () {56 vars in 1120 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:57.449409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.449409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.450038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] RBAC: Adding query filter params (type=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:57.450329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.451702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.453733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.456949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 505/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:57.462695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.475278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.559965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef529d18-b799-41af-94d8-f19e8d009abd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.567993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98184-0494-402c-9002-32b0e26f5b91 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.601611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.602249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.602530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.602805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.603464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:57.603766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.605154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.605257 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.605819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.606094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.606370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.607055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] RBAC: Adding query filter params (interface=public, service_id=9973c159b7fb4833a6975945600c30cb, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:57.607362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.608724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.618310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 528/1033] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:57.618492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 506/1034] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/endpoints?service_id=9973c159b7fb4833a6975945600c30cb&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:57.619712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.619897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.655870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.706961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.728797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b21c21-0736-4b4e-86a3-c17811a1801f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.733077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206fd9-bc74-4f07-8d56-70cd98875833 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.764986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.765611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.766144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.766413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.769510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.770121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.770398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.770667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.771264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.772650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.777088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.778492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.779397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 507/1035] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:57.794008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:57.795065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:57.796820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:57.796820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:57.796820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:57.796820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 529/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:57.801737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:57.919640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b9b3-b785-4256-a5d4-51df57a543be None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:57.958685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:57.959304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:57.959583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:57.959853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:57.960566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:57.960866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:57.962223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:57.969325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:57.975418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 508/1037] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:57.980787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:58.071306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:58.084289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fb5cb-19a4-4ad6-b29f-dd694070939a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:58.117355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:58.118223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.118670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.119107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.128117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:58.129703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:05:58.141461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:58.142538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:05:58.144203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:58.148079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 530/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:05:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:58.149591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:58.251467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa186012-0e0c-4e0f-b3d0-4a7ee40ce469 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:58.287650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:58.288301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.288576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.288841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.289568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:58.289870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:58.291301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dbe2-d602-4e09-9a4e-50987a6b6fe5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:58.313121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 509/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:05:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:58.314342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:58.412687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac9dcc-9748-4397-9a15-a6857c086fc5 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:58.445941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:58.446554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.446829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.447097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.465123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:58.519412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:58.520922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:58.616805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842805d3-e4dd-444c-845c-a199418e71a7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.617126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842805d3-e4dd-444c-845c-a199418e71a7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.617360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842805d3-e4dd-444c-845c-a199418e71a7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.618827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 510/1040] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:05:58.623618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 531/1041] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 01 04:05:58.624362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:58.624653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.624937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.625216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.644093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:58.645287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:05:58.675178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:58.698271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:58.715291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 511/1042] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:05:58.730334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca971-1b93-489c-bed3-d8f1ead7ef5b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:58.763439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:58.764093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.764373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.764643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.774685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:58.776143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:05:58.790845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:58.791824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:05:58.793257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:05:58.793257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:05:58.793257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:58.793257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 532/1043] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:58.797700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:58.903542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fdb6-22d6-4c2b-b069-1e9d7e80707e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:58.936688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:58.937231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:58.937508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:58.937782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:58.938443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:58.938744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:58.940696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:58.951966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 512/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:58.957422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:58.985415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.033066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.059143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.062249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dcd9-ca6d-4894-ac46-44ceb829bb0a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.097725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.098357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.098635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.098908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.102042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0fc8-4bba-4be2-9d36-17c1c9e7a619 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.105651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.107090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:05:59.118698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:59.119622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:05:59.120607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 533/1045] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:05:59.125387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.141675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.142340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.143116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.143388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.153668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:05:59.159499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:05:59.160667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:05:59.161558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:05:59.165522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 513/1046] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:05:59.166564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.233862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb0c3-467d-404d-8e90-692f30eb6501 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.269854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.270461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.270746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.271016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.271699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:59.272044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.273464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:59.275783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113fa25-1c1a-4a84-9cc4-6ff697d52c4f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.283272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.289244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 534/1047] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:59.294766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.316335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.319427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.320611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.321337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.321795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.322850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:59.323625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.325623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:59.336783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 514/1048] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:05:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:59.342520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.396487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b31f-8fe0-4964-bf17-e082281cf729 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.433221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.433831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.434108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.434807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.435531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] RBAC: Adding query filter params (role.id=333c08e0c9e74ef986e47f70a936b34f, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=424b048ef3454b8597a80c0f605b4c64) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:05:59.435839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.437294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:59.442850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 535/1049] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:05:59 2022] GET /identity/v3/role_assignments?user.id=424b048ef3454b8597a80c0f605b4c64&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=333c08e0c9e74ef986e47f70a936b34f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:05:59.447504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86284824-075f-40e7-bdfb-a4c378f2ecd2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.486586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.487203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.487486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.487763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] PATH_INFO: `/v3/users/6958be0a6cc04f6d97cbab377ca84769` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.504343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] RBAC: Authorizing `identity:get_user(user_id=6958be0a6cc04f6d97cbab377ca84769)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.505820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:59.512264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 515/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:05:59 2022] GET /identity/v3/users/6958be0a6cc04f6d97cbab377ca84769 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:05:59.513931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.618389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.635903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431abd7-92d3-4208-95a3-e1dc80b92c0a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.670397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc128-91a0-44ee-bbf4-8816b1cd50ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.671007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc128-91a0-44ee-bbf4-8816b1cd50ad None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.671284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc128-91a0-44ee-bbf4-8816b1cd50ad None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.671559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc128-91a0-44ee-bbf4-8816b1cd50ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.738939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cc128-91a0-44ee-bbf4-8816b1cd50ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.740320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cc128-91a0-44ee-bbf4-8816b1cd50ad None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:05:59.823033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.850359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 536/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:05:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:05:59.851985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:05:59.883239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:05:59.959409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2443b-c12a-4c36-83c6-bbeb1af6ebc3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:05:59.973761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f79c9-398c-4fd7-b24b-affa9b338fe9 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.974066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f79c9-398c-4fd7-b24b-affa9b338fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.974316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f79c9-398c-4fd7-b24b-affa9b338fe9 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.975631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 537/1052] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:05:59.980538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.980823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.981096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.996484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:05:59.997052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:05:59.997329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:05:59.997601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:05:59.998712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:05:59.998875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] RBAC: Authorizing `identity:get_project(project_id=006b193930c6468195c87c129fc75109)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:05:59.999920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:00.000167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:00.006940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 516/1053] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:05:59 2022] GET /identity/v3/projects/006b193930c6468195c87c129fc75109 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:00.007609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:00.075969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 538/1054] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:05:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:06:00.108564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:00.115967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e711-ec0e-4f3e-8186-47243aa08535 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:00.151846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:00.152491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:00.152773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:00.153044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:00.153764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=006b193930c6468195c87c129fc75109, user.id=6958be0a6cc04f6d97cbab377ca84769) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:00.154073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:00.155503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:00.167760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 517/1055] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:00 2022] GET /identity/v3/role_assignments?user.id=6958be0a6cc04f6d97cbab377ca84769&scope.project.id=006b193930c6468195c87c129fc75109&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:00.349454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:00.448879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a79f62-63cb-4f7f-8d27-ff623759d0c9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:00.462534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:00.484456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:00.485082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:00.485357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:00.485622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] PATH_INFO: `/v3/services/image` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:00.486218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:00.488165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:00.496713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:00.497696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 01 04:06:00.498578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:00.500078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 539/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Sat Oct 1 04:06:00 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:00.503776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:00.603242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af89a-5804-44f3-86da-7f4bec8ec40c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:00.638516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:00.639126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:00.639409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:00.639669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:00.640356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] RBAC: Adding query filter params (name=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:00.640893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:00.642245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:00.647976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 518/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:00.653401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:00.754293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27886ab8-1998-4374-9f8c-99b723ea3c0f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:00.787257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:00.787854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:00.788157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:00.788428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:00.789043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:00.789339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:00.790675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb61a-d7a8-4100-9cdf-45e469ddfbc4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:00.795536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 540/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:00.801631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:00.834422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:00.909197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b353b-9c78-4e3d-99ed-feeaa1543bdf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:00.941967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359b93-162d-4afb-8f74-d0c706cf06fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:00.942568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359b93-162d-4afb-8f74-d0c706cf06fc None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:00.942841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359b93-162d-4afb-8f74-d0c706cf06fc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:00.943105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359b93-162d-4afb-8f74-d0c706cf06fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:00.943766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359b93-162d-4afb-8f74-d0c706cf06fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:00.945140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359b93-162d-4afb-8f74-d0c706cf06fc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:00.965508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 519/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:06:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:06:01.615745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b5be-4f8b-48ef-8651-e7ffc33d40ad None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:01.616299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b5be-4f8b-48ef-8651-e7ffc33d40ad None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:01.616378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b5be-4f8b-48ef-8651-e7ffc33d40ad None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:01.617833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 541/1060] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:01.622722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:01.623016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:01.623298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:01.642146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:01.643396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:01.716931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 520/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:01.985789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433b5be-4f8b-48ef-8651-e7ffc33d40ad None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.035094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:02.093182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433b5be-4f8b-48ef-8651-e7ffc33d40ad None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.126728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12267e2-c641-418a-b2a9-6fb90a9235fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.127352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12267e2-c641-418a-b2a9-6fb90a9235fa None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.127675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12267e2-c641-418a-b2a9-6fb90a9235fa None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.127968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12267e2-c641-418a-b2a9-6fb90a9235fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.138243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12267e2-c641-418a-b2a9-6fb90a9235fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-a12267e2-c641-418a-b2a9-6fb90a9235fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:02.143945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:02.144878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:02.145742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 542/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Sat Oct 1 04:06:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:02.152475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.155535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:02.257532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6d905-ad46-4a4f-9aa8-3b21a6f6d780 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.292739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.293349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.293626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.293897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.294556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:02.294857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:02.296249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:02.309021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 521/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:02.309209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8eeb-fa67-4bd2-adb4-598968614531 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.309209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8eeb-fa67-4bd2-adb4-598968614531 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.309209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8eeb-fa67-4bd2-adb4-598968614531 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.310719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 543/1064] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:06:02.310842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.315481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.315763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.316060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.333992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:02.335164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:02.381502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:02.404485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 544/1065] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:06:02.419242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2285f-92e0-4bce-b1f8-aefa98ef51ce None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.453177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.453817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.454086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.454359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.464898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:02.466326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:06:02.480911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:02.481881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:06:02.482824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:06:02.482824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:02.482824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:02.484235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 522/1066] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:02.488293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.519746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:02.589462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd36b0-db1e-4ab7-abbf-e2e7d7c0930b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.623578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.624196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.624483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.624757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.625401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:02.625705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:02.627088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:02.638345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 545/1067] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:02.644097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.672414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.755413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ec7f-199d-4870-96b1-c895cebe3812 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.770266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:02.773600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:02.781985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257312d-b020-4d24-8a77-3baac9d08da7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.791466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.797190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.797190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.797190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.802477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:02.804030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:06:02.818986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:02.820316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:06:02.821572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:02.825307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 523/1068] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:02.826004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.837787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.838826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.839118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.839391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.852773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:02.857549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:02.858533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:02.859397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:02.864227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 546/1069] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:02.865158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:02.936966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c40a1-da48-4153-8ac2-b4346e964e1c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.970125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7e722-fd63-40b6-9dbf-9ead9ad189ac None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:02.971737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:02.972401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:02.972788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:02.973067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:02.973804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:02.974108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:02.975539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:02.994527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 524/1070] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:03.000824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.009715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.010324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.010603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.010873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.011528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:03.011831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.013219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.022999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 547/1071] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:03.028642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.037278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.045906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.107337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddb1bd-ad52-4550-b450-05125942e101 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.137766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04c1ea-14b2-45ac-8184-0fb8be75549c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.143032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.143671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.143962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.144238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.154412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.155980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-52bf5dab-2cec-430c-901c-dee2e420b590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:06:03.170681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:03.172012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:06:03.172991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:06:03.172991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:03.172991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:03.172991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 525/1072] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:03.172991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111046-8c75-48c1-94cb-19ee500d81ac None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.173309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111046-8c75-48c1-94cb-19ee500d81ac None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.173806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b111046-8c75-48c1-94cb-19ee500d81ac None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.174933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 526/1073] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:03.176652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e28453-187d-4781-ae11-69225e869c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.177288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e28453-187d-4781-ae11-69225e869c5c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.177569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e28453-187d-4781-ae11-69225e869c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.177839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e28453-187d-4781-ae11-69225e869c5c None admin] PATH_INFO: `/v3/users/6958be0a6cc04f6d97cbab377ca84769` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.178976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e28453-187d-4781-ae11-69225e869c5c None admin] RBAC: Authorizing `identity:get_user(user_id=6958be0a6cc04f6d97cbab377ca84769)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.179238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b111046-8c75-48c1-94cb-19ee500d81ac None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.180410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e28453-187d-4781-ae11-69225e869c5c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.181960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 548/1074] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/users/6958be0a6cc04f6d97cbab377ca84769 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:03.183181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.183466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.183739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.201461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:03.202638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:03.266779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.268379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 549/1075] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:03.269155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.283887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.285774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b111046-8c75-48c1-94cb-19ee500d81ac None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.322088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.322703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.326291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.326291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.326291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:03.326291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.326291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.342658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 527/1076] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:03.348204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.383801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaf306-89a1-4f66-b43f-2113138f53ae None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.422561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.424479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.424977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.425446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.427190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] RBAC: Authorizing `identity:get_project(project_id=006b193930c6468195c87c129fc75109)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.429462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.432405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 550/1077] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/projects/006b193930c6468195c87c129fc75109 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:03.438605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.449124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09810948-3494-4010-b2fd-0043cbf4231d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.485950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.486721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.487071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.487347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.493999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.495422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:06:03.506543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:03.512560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:03.514088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 528/1078] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:03.516954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.528508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.539145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.557906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f392c9-47a1-4308-ac38-94632511f808 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.591292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.591962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.592250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.592521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109/users/6958be0a6cc04f6d97cbab377ca84769/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.594415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=006b193930c6468195c87c129fc75109, user_id=6958be0a6cc04f6d97cbab377ca84769, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.596421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.608700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 551/1079] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:06:03 2022] PUT /identity/v3/projects/006b193930c6468195c87c129fc75109/users/6958be0a6cc04f6d97cbab377ca84769/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:06:03.609475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.628795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26d448-7465-4211-a9ab-e845d21c719b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.668403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.669102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.669381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.669655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.670375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:03.670689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.672209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.686198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 529/1080] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:03.692553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:03.725113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e723b2-e095-449a-a7c7-932c9aab3c83 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.761388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.762022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.762302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.762572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.768642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.775144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:03.815090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0088f6-ebe7-4c66-85e5-3cd4c6d30fc2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:03.849480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.850943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.855225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:03.856098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:03.856533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:03.856955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/424b048ef3454b8597a80c0f605b4c64/roles/333c08e0c9e74ef986e47f70a936b34f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:03.859240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=424b048ef3454b8597a80c0f605b4c64, role_id=333c08e0c9e74ef986e47f70a936b34f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:03.860843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:03.875569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 530/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:06:03 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/424b048ef3454b8597a80c0f605b4c64/roles/333c08e0c9e74ef986e47f70a936b34f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:06:03.959225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 552/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:03.965310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:04.078653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe61a90-de03-4c25-8a8c-c3b3ac748416 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:04.106724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:04.116334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:04.116974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:04.117248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:04.117515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:04.128555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:04.129999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dd848e29-2a9f-4b25-b853-52c656b41bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:06:04.145582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:04.146586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:06:04.147539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:06:04.147539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:04.147539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:04.147539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 531/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:04.153198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:04.196388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:04.257714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad46fb-aab2-4212-8cb8-5b18375ab2cd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:04.291632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:04.292424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:04.292802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:04.293172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:04.293910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:04.294312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:04.295769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5c22-ec8e-41b3-bb6d-b6dcf77c43d1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:04.315965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 553/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:05.755880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7ad9-7a0f-4ecd-a557-f663ddff93a4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:05.756423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7ad9-7a0f-4ecd-a557-f663ddff93a4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:05.756627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7ad9-7a0f-4ecd-a557-f663ddff93a4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:05.757807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 532/1085] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:05.763249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b49e0-edf5-4fcc-a0cc-f029476411ca None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:05.763686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b49e0-edf5-4fcc-a0cc-f029476411ca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:05.763779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b49e0-edf5-4fcc-a0cc-f029476411ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:05.782248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ad7b49e0-edf5-4fcc-a0cc-f029476411ca None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:05.784021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ad7b49e0-edf5-4fcc-a0cc-f029476411ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:05.853362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 554/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:06.033790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222ba8-42a2-47f3-bdbb-40d78887db56 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.033984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222ba8-42a2-47f3-bdbb-40d78887db56 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.034254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222ba8-42a2-47f3-bdbb-40d78887db56 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.035739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 533/1087] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:06.040722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.041012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.041293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.060840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:06.062029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:06.085383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.122338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222ba8-42a2-47f3-bdbb-40d78887db56 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.130768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 555/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:06.222630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222ba8-42a2-47f3-bdbb-40d78887db56 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.256290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.256908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.257183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.257450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.268249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:06.273041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:06.274144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:06.275023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 534/1089] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:06.280113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.374450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaabab-dcae-4477-a8fe-30e79e5b7aca None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.395177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.408870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.409535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.409818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.410089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.410752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:06.411055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:06.412434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:06.420343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 556/1090] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:06.426614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.442671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.450108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.501013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02478762-1e82-47ac-87ba-88e7b24d8d1a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.526397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1baee1-d98d-4afd-a2bb-9a00dba60337 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.541126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.541766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.542044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.542315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.552791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:06.557579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:06.558524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:06.559381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 535/1091] 10.222.0.27 () {56 vars in 1120 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:06.562447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.563077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.563418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.563702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] PATH_INFO: `/v3/users/6958be0a6cc04f6d97cbab377ca84769` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.564590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.564885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6958be0a6cc04f6d97cbab377ca84769)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:06.566300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:06.572380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 557/1092] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/users/6958be0a6cc04f6d97cbab377ca84769 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:06.573319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.660379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.663302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc54827-3a49-40f8-b53b-9882f29798be None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.663855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.674110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee646-9e62-46c0-ae2f-e4d102f049e7 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.696589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.697190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.697470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.697744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.698396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:06.698696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:06.700083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:06.706718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.707316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.707592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.707865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.708985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 536/1093] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:06.714699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.774612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:06.776082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:06.816351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6a810-9c76-40ee-a6e6-b2fcd2db0c7e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.850077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:06.850712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:06.850995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:06.851269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:06.861682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:06.863101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:06.863792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.874605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 558/1094] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:06:06.878180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:06.879292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:06:06.880240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:06:06.880240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:06.880240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:06.880240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 537/1095] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:06.884230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.884571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:06.899926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:06.980128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4907a-3739-4549-8a0b-3a6c108f4594 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:06.983580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4e462-df2f-437d-a422-f4bcb133825c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.013048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.013663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.013935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.014211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.015534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] RBAC: Authorizing `identity:get_project(project_id=006b193930c6468195c87c129fc75109)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.017035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.017523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.018124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.018402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.018620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 559/1096] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/projects/006b193930c6468195c87c129fc75109 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:07.018727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.019295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:07.019625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.020970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.024595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:07.038287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 538/1097] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:07.039645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:07.084260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:07.111732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:07.125564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40148-d511-4c6d-ad2f-5d6dcb0bb05b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.137759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efc818-dabb-4634-ba25-22c70a2b19c1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.158819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.159417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.159693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.159984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.160705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=006b193930c6468195c87c129fc75109, user.id=6958be0a6cc04f6d97cbab377ca84769) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:07.161008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.162420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.168273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 560/1098] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/role_assignments?user.id=6958be0a6cc04f6d97cbab377ca84769&scope.project.id=006b193930c6468195c87c129fc75109&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:07.171732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261008e-6342-481d-aa54-897acb2026af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.172395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261008e-6342-481d-aa54-897acb2026af None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.172720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261008e-6342-481d-aa54-897acb2026af None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.172992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261008e-6342-481d-aa54-897acb2026af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.181040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261008e-6342-481d-aa54-897acb2026af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.182516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261008e-6342-481d-aa54-897acb2026af None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1261008e-6342-481d-aa54-897acb2026af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:06:07.195900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:07.197068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:07.198049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 539/1099] 10.222.0.27 () {56 vars in 1093 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:06:07.203192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:07.306808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745fca7-647f-4097-a5a8-c5e3301590cd None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.330186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:07.341598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.342546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.342546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.342744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.343452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:07.343756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.345246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.363001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 561/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:07.368781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261008e-6342-481d-aa54-897acb2026af None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:07.467426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261008e-6342-481d-aa54-897acb2026af None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.500172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.500778 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.501050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.501316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.503841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:07.569563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.570921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.665946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 540/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:07.671639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:07.766874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26048f-7668-4079-a062-9930ef54beba None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.799372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.800015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.800294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.800577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.812067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.813487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:06:07.828074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:07.829184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:06:07.830641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:06:07.830641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:06:07.830641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:07.830641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 562/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:07.835529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:07.867609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:07.933042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387955c1-280f-4bc3-a7fb-4186d978eca7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:07.966764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:07.967359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:07.967636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:07.967905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:07.968565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:07.968865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:07.970276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:07.981077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 541/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:07.987146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:08.017748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:08.085953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8845fe-919a-4387-91c9-23e5297b9b7a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:08.118428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:08.119042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:08.119315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:08.119580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:08.125884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:08.127864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:06:08.138672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:08.139666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:08.140880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 563/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:08.145836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:08.235041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:08.242395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6523112-3981-432b-a287-3b6f7f44fc7d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:08.275404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:08.276022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:08.276296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:08.276561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:08.277233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:08.277532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:08.278951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f35f00-17ec-4a6e-8abb-ccc2fcef5d91 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:08.291069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 542/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:08.296997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:08.384732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:08.393975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe198ff-ead8-4c07-8cba-0c765e838844 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:08.426759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:08.427353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:08.427626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:08.427894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:08.428635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] RBAC: Adding query filter params (role.id=333c08e0c9e74ef986e47f70a936b34f, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=424b048ef3454b8597a80c0f605b4c64) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:08.428935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:08.430333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0bd53-bc96-447d-9823-7c0ad786b999 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:08.436080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 564/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:08 2022] GET /identity/v3/role_assignments?user.id=424b048ef3454b8597a80c0f605b4c64&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=333c08e0c9e74ef986e47f70a936b34f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:09.367991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f986efc-7122-4563-8200-1b9ca5787e28 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:09.368520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f986efc-7122-4563-8200-1b9ca5787e28 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:09.368520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f986efc-7122-4563-8200-1b9ca5787e28 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:09.369854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 543/1107] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:09.375302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:09.375695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:09.375852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:09.394864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:09.396076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:09.459320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 565/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:09.724572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f986efc-7122-4563-8200-1b9ca5787e28 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:09.822624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f986efc-7122-4563-8200-1b9ca5787e28 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:09.855894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00f42d-1bdb-4d39-94c3-fd1d6ecefc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:09.856526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f42d-1bdb-4d39-94c3-fd1d6ecefc43 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:09.856800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f42d-1bdb-4d39-94c3-fd1d6ecefc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:09.857065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00f42d-1bdb-4d39-94c3-fd1d6ecefc43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:09.858138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00f42d-1bdb-4d39-94c3-fd1d6ecefc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:09.859543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00f42d-1bdb-4d39-94c3-fd1d6ecefc43 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:09.861707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 544/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:09.867635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:09.948062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:09.962432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007446d-ced9-4a59-904c-8c9f6a5e36c7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:09.994941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943fdf-27d3-4887-8c0a-62bab75f298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:09.995530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943fdf-27d3-4887-8c0a-62bab75f298d None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:09.995808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943fdf-27d3-4887-8c0a-62bab75f298d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:09.996111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943fdf-27d3-4887-8c0a-62bab75f298d None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:09.996750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943fdf-27d3-4887-8c0a-62bab75f298d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:09.998159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943fdf-27d3-4887-8c0a-62bab75f298d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:10.017964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 566/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:06:09 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:06:12.166455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983b3f-1a06-4bff-b635-ae23eeb4d81e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:12.171682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983b3f-1a06-4bff-b635-ae23eeb4d81e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:12.171682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983b3f-1a06-4bff-b635-ae23eeb4d81e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:12.171682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 545/1111] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:12.174829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:12.175218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:12.175377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:12.193514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:12.194690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:12.257705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 567/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:12.522949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a983b3f-1a06-4bff-b635-ae23eeb4d81e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:12.547141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:12.621064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a983b3f-1a06-4bff-b635-ae23eeb4d81e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:12.654134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:12.654756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:12.655034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:12.655306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] PATH_INFO: `/v3/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:12.656699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] RBAC: Authorizing `identity:get_role(role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:12.658628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:12.659924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 546/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:12 2022] GET /identity/v3/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:12.665539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:12.732011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:12.760518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b3cf6-f8e7-42e5-a686-0518de7c1c70 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:12.793352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:12.793915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:12.794192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:12.794463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] PATH_INFO: `/v3/users/22fa29d35cda4e64859e2031b046c0fe` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:12.809490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=22fa29d35cda4e64859e2031b046c0fe)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:12.810916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:12.812564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 568/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:12 2022] GET /identity/v3/users/22fa29d35cda4e64859e2031b046c0fe => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:12.818220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:12.906578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:12.916413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee961f0-31de-41cb-8268-956969f6f51f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:12.949307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:12.949901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:12.950175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:12.950442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:13.013892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:13.015575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:13.098780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:13.108808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 547/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:13.114727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:13.210080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897a2db-032e-4749-bc0e-fdc44af58ce8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:13.238038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:13.243980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b19be-b087-4993-82fc-5755c880b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:13.244596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b19be-b087-4993-82fc-5755c880b7ba None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:13.244875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b19be-b087-4993-82fc-5755c880b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:13.245146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b19be-b087-4993-82fc-5755c880b7ba None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:13.246238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b19be-b087-4993-82fc-5755c880b7ba None admin] RBAC: Authorizing `identity:get_project(project_id=006b193930c6468195c87c129fc75109)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:13.247634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b19be-b087-4993-82fc-5755c880b7ba None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:13.249224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 569/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:13 2022] GET /identity/v3/projects/006b193930c6468195c87c129fc75109 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:13.255749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:13.353553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6287741-2514-4932-a77c-0768a5c5247b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:13.396884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:13.397755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:13.398169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:13.398569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:13.399593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] RBAC: Adding query filter params (role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=006b193930c6468195c87c129fc75109, user.id=22fa29d35cda4e64859e2031b046c0fe) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:13.399862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:13.402057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb26c-c1aa-4006-aa56-f838b3402579 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:13.409192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 548/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:13 2022] GET /identity/v3/role_assignments?user.id=22fa29d35cda4e64859e2031b046c0fe&scope.project.id=006b193930c6468195c87c129fc75109&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:15.527319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a33c-0082-4471-a362-0921da6d3b3f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:15.527847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a33c-0082-4471-a362-0921da6d3b3f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:15.527847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6a33c-0082-4471-a362-0921da6d3b3f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:15.529235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 570/1118] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:15.534855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:15.535240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:15.535391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:15.552972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:15.554138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:15.602043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:15.618881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 549/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:15.887581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a33c-0082-4471-a362-0921da6d3b3f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:15.984196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6a33c-0082-4471-a362-0921da6d3b3f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:16.017583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:16.018198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:16.018477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:16.018773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] PATH_INFO: `/v3/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:16.020162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] RBAC: Authorizing `identity:get_role(role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:16.021512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:16.022792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 571/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:15 2022] GET /identity/v3/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:16.028363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:16.122030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da5904-2515-43ce-9e58-39f61df05b36 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:16.156191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:16.156801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:16.157099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:16.157366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] PATH_INFO: `/v3/users/22fa29d35cda4e64859e2031b046c0fe` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:16.158451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] RBAC: Authorizing `identity:get_user(user_id=22fa29d35cda4e64859e2031b046c0fe)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:16.159850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:16.161394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 550/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:16 2022] GET /identity/v3/users/22fa29d35cda4e64859e2031b046c0fe => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:16.166970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:16.229329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:16.263568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6fc9e-b901-4b28-9ba5-67b80a7e24e6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:16.296308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a590c-e941-4e32-a0e8-116870d39db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:16.296922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a590c-e941-4e32-a0e8-116870d39db3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:16.297203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a590c-e941-4e32-a0e8-116870d39db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:16.297503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a590c-e941-4e32-a0e8-116870d39db3 None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:16.298599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a590c-e941-4e32-a0e8-116870d39db3 None admin] RBAC: Authorizing `identity:get_project(project_id=006b193930c6468195c87c129fc75109)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:16.300026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a590c-e941-4e32-a0e8-116870d39db3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:16.301604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 572/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:16 2022] GET /identity/v3/projects/006b193930c6468195c87c129fc75109 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:16.307273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:16.357858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:16.403139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684b03-b669-46c3-b82a-12305dafb83c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:16.435601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c17ac-db8e-4c6e-8979-64f13d533492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:16.436265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c17ac-db8e-4c6e-8979-64f13d533492 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:16.436538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c17ac-db8e-4c6e-8979-64f13d533492 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:16.436809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c17ac-db8e-4c6e-8979-64f13d533492 None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109/users/22fa29d35cda4e64859e2031b046c0fe/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:16.438957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c17ac-db8e-4c6e-8979-64f13d533492 None admin] RBAC: Authorizing `identity:create_grant(project_id=006b193930c6468195c87c129fc75109, user_id=22fa29d35cda4e64859e2031b046c0fe, role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:16.440388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c17ac-db8e-4c6e-8979-64f13d533492 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:16.453204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 551/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:06:16 2022] PUT /identity/v3/projects/006b193930c6468195c87c129fc75109/users/22fa29d35cda4e64859e2031b046c0fe/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:06:18.562747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a103d3-d3e3-440a-a4fe-36c42a03fa8f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:18.563309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a103d3-d3e3-440a-a4fe-36c42a03fa8f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:18.563309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a103d3-d3e3-440a-a4fe-36c42a03fa8f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:18.564719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 573/1124] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:18.569834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:18.570213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:18.570380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:18.588602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:18.589768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:18.654557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 552/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:18.933450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a103d3-d3e3-440a-a4fe-36c42a03fa8f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:19.031345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a103d3-d3e3-440a-a4fe-36c42a03fa8f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:19.063374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:19.064019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:19.064300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:19.064574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] PATH_INFO: `/v3/roles/ad62ebeb12d54cd2aef6c3e20344f903` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:19.065940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] RBAC: Authorizing `identity:get_role(role_id=ad62ebeb12d54cd2aef6c3e20344f903)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:19.067302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:19.068620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 574/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:18 2022] GET /identity/v3/roles/ad62ebeb12d54cd2aef6c3e20344f903 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:19.074215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:19.115404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:19.171367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91fd4d-8a35-4eff-97f7-65177332f560 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:19.204512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:19.205126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:19.205404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:19.205677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] PATH_INFO: `/v3/users/22fa29d35cda4e64859e2031b046c0fe` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:19.206782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] RBAC: Authorizing `identity:get_user(user_id=22fa29d35cda4e64859e2031b046c0fe)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:19.208221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:19.209780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 553/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:19 2022] GET /identity/v3/users/22fa29d35cda4e64859e2031b046c0fe => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:19.215512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:19.218288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:19.312256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005735-22dd-4274-8e40-bbe9a25ace0b None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:19.344179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:19.344773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:19.345054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:19.345326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:19.421737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:19.423629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:19.425396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:19.518787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 575/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:19.524743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:19.620586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1bdce-4f7d-46fe-abd6-e019a1a971d5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:19.632197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:19.655135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32eec2-0cc1-47f5-af1a-dc0641f4404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:19.655757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32eec2-0cc1-47f5-af1a-dc0641f4404a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:19.656062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32eec2-0cc1-47f5-af1a-dc0641f4404a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:19.656328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32eec2-0cc1-47f5-af1a-dc0641f4404a None admin] PATH_INFO: `/v3/projects/006b193930c6468195c87c129fc75109` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:19.657942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32eec2-0cc1-47f5-af1a-dc0641f4404a None admin] RBAC: Authorizing `identity:get_project(project_id=006b193930c6468195c87c129fc75109)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:19.659345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32eec2-0cc1-47f5-af1a-dc0641f4404a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:19.660964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 554/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:19 2022] GET /identity/v3/projects/006b193930c6468195c87c129fc75109 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:19.667062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:19.761209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f035-2c50-4a45-bc45-9ea046c70f88 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:19.762708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:19.794527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:19.795110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:19.795384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:19.795654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:19.796436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] RBAC: Adding query filter params (role.id=ad62ebeb12d54cd2aef6c3e20344f903, scope.project.id=006b193930c6468195c87c129fc75109, user.id=22fa29d35cda4e64859e2031b046c0fe) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:19.796737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:19.798731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa817c-55c1-4bb6-8fbf-7f9f5b5eb41c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:19.804204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 576/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:19 2022] GET /identity/v3/role_assignments?user.id=22fa29d35cda4e64859e2031b046c0fe&scope.project.id=006b193930c6468195c87c129fc75109&role.id=ad62ebeb12d54cd2aef6c3e20344f903 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:21.911448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61438-edee-4688-8a07-6a0ef1130a32 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:21.911911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61438-edee-4688-8a07-6a0ef1130a32 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:21.912039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e61438-edee-4688-8a07-6a0ef1130a32 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:21.913328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 555/1131] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:21.918459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:21.918850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:21.919008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:21.936750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:21.938421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:22.002322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 577/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:22.262419 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e61438-edee-4688-8a07-6a0ef1130a32 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:22.359389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e61438-edee-4688-8a07-6a0ef1130a32 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:22.391681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe31d-d9f9-4af0-9f11-b110b7b32bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:22.392317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe31d-d9f9-4af0-9f11-b110b7b32bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:22.392590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe31d-d9f9-4af0-9f11-b110b7b32bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:22.392854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe31d-d9f9-4af0-9f11-b110b7b32bd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:22.393935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe31d-d9f9-4af0-9f11-b110b7b32bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:22.395333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe31d-d9f9-4af0-9f11-b110b7b32bd8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:22.396873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 556/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:22.402610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:22.491138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:22.497460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee058b-63cb-4277-bc6e-4f05b0f1f0eb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:22.530562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83244c-34d1-4d64-a385-87222b0a99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:22.531101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83244c-34d1-4d64-a385-87222b0a99a9 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:22.531377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83244c-34d1-4d64-a385-87222b0a99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:22.531646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83244c-34d1-4d64-a385-87222b0a99a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:22.532311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83244c-34d1-4d64-a385-87222b0a99a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:22.533711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83244c-34d1-4d64-a385-87222b0a99a9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:22.559023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 578/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:06:22 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:06:24.708130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf50c1-fe58-48e6-8041-a6c07b2fa90f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:24.708648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf50c1-fe58-48e6-8041-a6c07b2fa90f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:24.708769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf50c1-fe58-48e6-8041-a6c07b2fa90f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:24.710005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 557/1135] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:24.715111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:24.715544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:24.715664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:24.733840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:24.735492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:24.798751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 579/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:25.071385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf50c1-fe58-48e6-8041-a6c07b2fa90f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:25.118589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:25.170493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf50c1-fe58-48e6-8041-a6c07b2fa90f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:25.203420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a20c37-fdee-4e7c-a793-544aba955e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:25.204065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a20c37-fdee-4e7c-a793-544aba955e6f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:25.204342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a20c37-fdee-4e7c-a793-544aba955e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:25.204608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a20c37-fdee-4e7c-a793-544aba955e6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:25.205707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a20c37-fdee-4e7c-a793-544aba955e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:25.207116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a20c37-fdee-4e7c-a793-544aba955e6f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:25.208669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 558/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:06:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:25.214215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:25.288244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:25.308724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b5404-54b2-447d-ab91-2e76f84d86c7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:25.340520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b74502-2b2d-4518-9ac5-aa20a21482f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:25.341055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74502-2b2d-4518-9ac5-aa20a21482f2 None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:25.341329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74502-2b2d-4518-9ac5-aa20a21482f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:25.341593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74502-2b2d-4518-9ac5-aa20a21482f2 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:25.342228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b74502-2b2d-4518-9ac5-aa20a21482f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:25.343632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b74502-2b2d-4518-9ac5-aa20a21482f2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:25.363387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 580/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:06:25 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:06:27.518245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3cb9-e285-44f5-86ae-b6337a3ec57f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:27.518775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3cb9-e285-44f5-86ae-b6337a3ec57f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:27.518775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3cb9-e285-44f5-86ae-b6337a3ec57f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:27.520121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 559/1139] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:27.525395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:27.525790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:27.525950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:27.544316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:27.545490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:27.609669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 581/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:06:27.880171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3cb9-e285-44f5-86ae-b6337a3ec57f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:27.977726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3cb9-e285-44f5-86ae-b6337a3ec57f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:27.991108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:28.011239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:28.011860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:28.012206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:28.012481 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:28.022542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:28.027292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:28.028508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:28.029456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 560/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:28.034870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:28.094264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:28.131144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20ed5-0307-4ce6-ad03-8e2ba55e0d84 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:28.163527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:28.164214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:28.164495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:28.164766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:28.165421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:28.165729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:28.167070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:28.175264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 582/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:28.181040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:28.277397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af6778-ed29-43d9-9054-5ccb351515cc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:28.310163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:28.310767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:28.311042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:28.311310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] PATH_INFO: `/v3/users/dbd5c19502f34fd488f14351da31ea22` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:28.323631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] RBAC: Authorizing `identity:get_user(user_id=dbd5c19502f34fd488f14351da31ea22)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:28.325077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:28.326617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 561/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:28 2022] GET /identity/v3/users/dbd5c19502f34fd488f14351da31ea22 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:28.332765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:28.428217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3537a-98f0-41c7-a461-ad89c7f1b61d None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:28.451855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:28.461046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:28.461636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:28.461912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:28.462179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:28.525337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:28.526742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:28.618211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 583/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:28.624270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:28.656062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:28.721399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911c3b-9687-4c39-826e-9f75b1bac60a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:28.754052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286780d-4dca-4ac5-8cc4-782dbbadae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:28.754659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286780d-4dca-4ac5-8cc4-782dbbadae3b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:28.754933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286780d-4dca-4ac5-8cc4-782dbbadae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:28.755199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286780d-4dca-4ac5-8cc4-782dbbadae3b None admin] PATH_INFO: `/v3/projects/ddda7c3a44824b29850c67878c35e815` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:28.756310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286780d-4dca-4ac5-8cc4-782dbbadae3b None admin] RBAC: Authorizing `identity:get_project(project_id=ddda7c3a44824b29850c67878c35e815)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:28.757701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286780d-4dca-4ac5-8cc4-782dbbadae3b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:28.759274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 562/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:28 2022] GET /identity/v3/projects/ddda7c3a44824b29850c67878c35e815 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:28.766149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:28.792933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:28.861718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc6c6f-d30f-4a6e-9bf7-8bd4ce6fa47a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:28.893377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:28.893962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:28.894236 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:28.894504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:28.895213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=ddda7c3a44824b29850c67878c35e815, user.id=dbd5c19502f34fd488f14351da31ea22) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:28.895531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:28.896961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0954e-8b1f-4073-9fb8-a6a679f67ace None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:28.902044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 584/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:28 2022] GET /identity/v3/role_assignments?user.id=dbd5c19502f34fd488f14351da31ea22&scope.project.id=ddda7c3a44824b29850c67878c35e815&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:06:31.015763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5c3ca-2e6b-42fd-a48c-614c0f133735 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:31.016302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5c3ca-2e6b-42fd-a48c-614c0f133735 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:31.016390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5c3ca-2e6b-42fd-a48c-614c0f133735 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:31.017663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 563/1147] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:31.022875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:31.023308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:31.023430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:31.041108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:31.042284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:31.105728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 585/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:31.373476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5c3ca-2e6b-42fd-a48c-614c0f133735 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:31.469979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:31.474194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5c3ca-2e6b-42fd-a48c-614c0f133735 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:31.507396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:31.508047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:31.508325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:31.508596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:31.519153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:31.523950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:31.525046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:31.526081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 564/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:31.531847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:31.552360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:31.626935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47faf2-a4aa-490d-891c-bb885cd77a94 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:31.659352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b043f-162c-4592-bdde-96962860027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:31.659967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b043f-162c-4592-bdde-96962860027e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:31.660240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b043f-162c-4592-bdde-96962860027e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:31.660509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b043f-162c-4592-bdde-96962860027e None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:31.661157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b043f-162c-4592-bdde-96962860027e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:31.661455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b043f-162c-4592-bdde-96962860027e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:31.662788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b043f-162c-4592-bdde-96962860027e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:31.670385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 586/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:31.676759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:31.772411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4162-3f6d-4f1b-a68a-99533b11f3da None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:31.805667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:31.806285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:31.806564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:31.806838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] PATH_INFO: `/v3/users/dbd5c19502f34fd488f14351da31ea22` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:31.807976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] RBAC: Authorizing `identity:get_user(user_id=dbd5c19502f34fd488f14351da31ea22)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:31.809400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:31.810957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 565/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:31 2022] GET /identity/v3/users/dbd5c19502f34fd488f14351da31ea22 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:31.816615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b043f-162c-4592-bdde-96962860027e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:31.894292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:31.911825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b043f-162c-4592-bdde-96962860027e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:31.943390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907f39-cb5a-4a2c-bd97-da09f0bfd63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:31.944035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907f39-cb5a-4a2c-bd97-da09f0bfd63b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:31.944314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907f39-cb5a-4a2c-bd97-da09f0bfd63b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:31.944583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907f39-cb5a-4a2c-bd97-da09f0bfd63b None admin] PATH_INFO: `/v3/projects/ddda7c3a44824b29850c67878c35e815` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:31.945662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907f39-cb5a-4a2c-bd97-da09f0bfd63b None admin] RBAC: Authorizing `identity:get_project(project_id=ddda7c3a44824b29850c67878c35e815)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:31.947063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907f39-cb5a-4a2c-bd97-da09f0bfd63b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:31.948681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 587/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:31 2022] GET /identity/v3/projects/ddda7c3a44824b29850c67878c35e815 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:31.954638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:31.982129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:32.052217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2392d-d816-4f12-9549-d9eab02284ac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:32.084942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faffd79-e869-4252-b23b-3c809464cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:32.085581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faffd79-e869-4252-b23b-3c809464cb54 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:32.085859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faffd79-e869-4252-b23b-3c809464cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:32.086129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faffd79-e869-4252-b23b-3c809464cb54 None admin] PATH_INFO: `/v3/projects/ddda7c3a44824b29850c67878c35e815/users/dbd5c19502f34fd488f14351da31ea22/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:32.088115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faffd79-e869-4252-b23b-3c809464cb54 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddda7c3a44824b29850c67878c35e815, user_id=dbd5c19502f34fd488f14351da31ea22, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:32.089539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faffd79-e869-4252-b23b-3c809464cb54 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:32.102038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 566/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:06:31 2022] PUT /identity/v3/projects/ddda7c3a44824b29850c67878c35e815/users/dbd5c19502f34fd488f14351da31ea22/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:06:34.200404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3d97-99d8-442d-866b-253ae02cb68f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:34.200944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3d97-99d8-442d-866b-253ae02cb68f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:34.200944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3d97-99d8-442d-866b-253ae02cb68f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:34.202171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 588/1154] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:34.207980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:34.208376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:34.208520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:34.226068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:34.227234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:34.292468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 567/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:34.562744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3d97-99d8-442d-866b-253ae02cb68f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:34.659444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3d97-99d8-442d-866b-253ae02cb68f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:34.691097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:34.691704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:34.692000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:34.692273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:34.701801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:34.707109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:34.708434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:34.709712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 589/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:34.714131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:34.731960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:34.811079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98385-7b9c-4938-8590-4cf1bb40b73d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:34.845087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:34.845690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:34.845971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:34.846245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:34.846900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:34.847203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:34.848595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:34.856345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 568/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:34.862159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:34.875019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:34.959053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4859e-bd52-4c34-8af9-4f8e2ec6979f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:34.991148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:34.991757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:34.992064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:34.992339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] PATH_INFO: `/v3/users/dbd5c19502f34fd488f14351da31ea22` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:34.993427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] RBAC: Authorizing `identity:get_user(user_id=dbd5c19502f34fd488f14351da31ea22)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:34.994865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:34.996427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 590/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:34 2022] GET /identity/v3/users/dbd5c19502f34fd488f14351da31ea22 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:35.002754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:35.081404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:35.099995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7801cc-6ff7-4e62-b93a-9ca5082e92b3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:35.132868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:35.133456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:35.133735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:35.134006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:35.198366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:35.199793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:35.275252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:35.294905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 569/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:35.300898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:35.375722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:35.396405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b411d3-87d6-49b1-88bf-0b3d076079ab None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:35.428448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bce00-b8c4-4b8e-bcf0-9289c7e208d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:35.429055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bce00-b8c4-4b8e-bcf0-9289c7e208d1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:35.429328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bce00-b8c4-4b8e-bcf0-9289c7e208d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:35.429595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bce00-b8c4-4b8e-bcf0-9289c7e208d1 None admin] PATH_INFO: `/v3/projects/ddda7c3a44824b29850c67878c35e815` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:35.430663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bce00-b8c4-4b8e-bcf0-9289c7e208d1 None admin] RBAC: Authorizing `identity:get_project(project_id=ddda7c3a44824b29850c67878c35e815)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:35.432086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bce00-b8c4-4b8e-bcf0-9289c7e208d1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:35.433634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 591/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:35 2022] GET /identity/v3/projects/ddda7c3a44824b29850c67878c35e815 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:35.439687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:35.536103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4b93b-bbdd-4572-af0f-e8f960264e98 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:35.568749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:35.569346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:35.569622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:35.569896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:35.570610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=ddda7c3a44824b29850c67878c35e815, user.id=dbd5c19502f34fd488f14351da31ea22) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:35.570916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:35.572349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f25a-9b8f-4126-991c-957e27485679 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:35.578575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 570/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:35 2022] GET /identity/v3/role_assignments?user.id=dbd5c19502f34fd488f14351da31ea22&scope.project.id=ddda7c3a44824b29850c67878c35e815&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:37.702430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d9466-f352-45b5-8914-c0155cb7d534 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:37.702985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d9466-f352-45b5-8914-c0155cb7d534 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:37.702985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d9466-f352-45b5-8914-c0155cb7d534 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:37.704309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 592/1162] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:37.709501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:37.709933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:37.710039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:37.728308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:37.729492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:37.768661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:37.794925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 571/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:38.057741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d9466-f352-45b5-8914-c0155cb7d534 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:38.155017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d9466-f352-45b5-8914-c0155cb7d534 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:38.187521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:38.188262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:38.188541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:38.188811 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:38.203383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:38.252374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:38.253790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:38.346501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 593/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:38.352438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:38.449056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0b17-010d-4623-856b-f7a02ec88a5a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:38.481814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:38.482433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:38.482713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:38.482987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:38.489506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:38.490925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0387e6de-06f6-44d2-87c3-559c541978f4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:38.502589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:38.503798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:38.504704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 572/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:06:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:38.509455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:38.553776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:38.604771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27258ae5-a152-4e52-a08c-9137dd7f99b9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:38.636974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:38.637560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:38.637843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:38.638118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:38.638754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:38.639312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:38.640781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f544df9-a6e2-4dd9-a748-078bbb2ce5e1 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:38.647629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 594/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Sat Oct 1 04:06:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:40.754992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032194-50cd-4794-b181-e8c77697e16d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:40.755535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032194-50cd-4794-b181-e8c77697e16d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:40.755535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032194-50cd-4794-b181-e8c77697e16d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:40.756914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 573/1167] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:40.762097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350e36b-f35b-4cf4-ae15-b8723f601c44 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:40.762527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350e36b-f35b-4cf4-ae15-b8723f601c44 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:40.762629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350e36b-f35b-4cf4-ae15-b8723f601c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:40.781490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8350e36b-f35b-4cf4-ae15-b8723f601c44 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:40.782651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8350e36b-f35b-4cf4-ae15-b8723f601c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:40.849653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 595/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:41.116452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032194-50cd-4794-b181-e8c77697e16d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:41.152145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:41.217261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032194-50cd-4794-b181-e8c77697e16d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:41.250269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50028a3e-cf4a-4dd7-8f6b-0d909a039385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:41.250859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50028a3e-cf4a-4dd7-8f6b-0d909a039385 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:41.251130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50028a3e-cf4a-4dd7-8f6b-0d909a039385 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:41.251397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50028a3e-cf4a-4dd7-8f6b-0d909a039385 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:41.252234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50028a3e-cf4a-4dd7-8f6b-0d909a039385 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:41.253589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50028a3e-cf4a-4dd7-8f6b-0d909a039385 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:41.269830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 574/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Sat Oct 1 04:06:41 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:06:43.398585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07ff3-3405-4d6f-a97e-8ffce4ad58c4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:43.399128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07ff3-3405-4d6f-a97e-8ffce4ad58c4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:43.399128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d07ff3-3405-4d6f-a97e-8ffce4ad58c4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:43.400497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 596/1170] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:43.405824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:43.406198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:43.406373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:43.424569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:43.425755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:43.489373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 575/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:43.755979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07ff3-3405-4d6f-a97e-8ffce4ad58c4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:43.797671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:43.853889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d07ff3-3405-4d6f-a97e-8ffce4ad58c4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:43.885987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94702e86-9489-48e5-b577-3bf63098b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:43.886622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94702e86-9489-48e5-b577-3bf63098b065 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:43.886883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94702e86-9489-48e5-b577-3bf63098b065 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:43.887153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94702e86-9489-48e5-b577-3bf63098b065 None admin] PATH_INFO: `/v3/domains/88eecb24f1fc41619eb373e721a9446c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:43.897303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94702e86-9489-48e5-b577-3bf63098b065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=88eecb24f1fc41619eb373e721a9446c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:43.898722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94702e86-9489-48e5-b577-3bf63098b065 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:43.900301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 597/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Sat Oct 1 04:06:43 2022] GET /identity/v3/domains/88eecb24f1fc41619eb373e721a9446c => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:43.906641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:43.930672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:44.007274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8e07a-d18f-49fe-8db0-6cdc4baf68c7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:44.040472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f336-0a4b-476a-a06c-fd3b879edeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:44.041065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f336-0a4b-476a-a06c-fd3b879edeec None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:44.041344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f336-0a4b-476a-a06c-fd3b879edeec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:44.041615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f336-0a4b-476a-a06c-fd3b879edeec None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:44.042248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f336-0a4b-476a-a06c-fd3b879edeec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:44.043670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f336-0a4b-476a-a06c-fd3b879edeec None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:44.068488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 576/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:06:43 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:06:46.213886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00c76-22d2-4858-a1fd-808157c52758 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:46.214412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00c76-22d2-4858-a1fd-808157c52758 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:46.214412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb00c76-22d2-4858-a1fd-808157c52758 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:46.215653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 598/1174] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:46.221071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:46.221529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:46.221622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:46.240043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:46.241221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:46.305816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 577/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:46.573234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00c76-22d2-4858-a1fd-808157c52758 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:46.668558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:46.672378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb00c76-22d2-4858-a1fd-808157c52758 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:46.705044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffdd87-196d-4649-9ec1-c192b439dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:46.705653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffdd87-196d-4649-9ec1-c192b439dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:46.705925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffdd87-196d-4649-9ec1-c192b439dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:46.706194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffdd87-196d-4649-9ec1-c192b439dcc2 None admin] PATH_INFO: `/v3/domains/88eecb24f1fc41619eb373e721a9446c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:46.707273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffdd87-196d-4649-9ec1-c192b439dcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=88eecb24f1fc41619eb373e721a9446c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:46.708696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffdd87-196d-4649-9ec1-c192b439dcc2 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:46.710201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 599/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Sat Oct 1 04:06:46 2022] GET /identity/v3/domains/88eecb24f1fc41619eb373e721a9446c => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:46.715899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:46.723952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:46.813643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f261d8e-5386-46e9-b2b2-3100c6af8fed None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:46.847174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e18247-50da-4374-8219-6653be99c126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:46.847772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18247-50da-4374-8219-6653be99c126 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:46.848076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18247-50da-4374-8219-6653be99c126 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:46.848343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e18247-50da-4374-8219-6653be99c126 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:46.848976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18247-50da-4374-8219-6653be99c126 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:46.850385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e18247-50da-4374-8219-6653be99c126 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:46.871158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 578/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:06:46 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:06:49.020159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8cfb5-0f99-49a2-b941-472685361e2f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:49.020773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8cfb5-0f99-49a2-b941-472685361e2f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:49.020773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8cfb5-0f99-49a2-b941-472685361e2f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:49.022022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 600/1178] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:49.027113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:49.027543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:49.027645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:49.046522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:49.047700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:49.102219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:49.114035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 579/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:49.410367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8cfb5-0f99-49a2-b941-472685361e2f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:49.507725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8cfb5-0f99-49a2-b941-472685361e2f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:49.540529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:49.541139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:49.541416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:49.541687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:49.551899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:49.556687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:49.557893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:49.559037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 601/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:49.564746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:49.674472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96a766-170d-4542-98a0-c3186755cb79 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:49.707474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:49.708101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:49.708375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:49.708639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:49.709289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:49.709581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:49.710922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:49.718589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 580/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:49.724577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:49.752722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:49.821565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911abc58-80ff-497a-96f5-1bd7be6b4b97 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:49.854587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:49.855208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:49.855487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:49.855759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] PATH_INFO: `/v3/users/1a74756fca874317b00cb826310ec271` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:49.868439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] RBAC: Authorizing `identity:get_user(user_id=1a74756fca874317b00cb826310ec271)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:49.869867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:49.871444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 602/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:49 2022] GET /identity/v3/users/1a74756fca874317b00cb826310ec271 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:49.877673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:49.930716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:49.974190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3559c7-2762-4a45-88d5-4580055718bd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:50.006657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:50.007247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:50.007524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:50.007790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:50.072657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:50.074096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:50.125349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:50.168630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 581/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:50.174963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:50.254574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:50.269525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc29d3b-2c10-4fbe-838e-9e01739dbf51 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:50.301289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64a489-9d39-46f3-8130-31e092912897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:50.301895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64a489-9d39-46f3-8130-31e092912897 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:50.302170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64a489-9d39-46f3-8130-31e092912897 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:50.302440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64a489-9d39-46f3-8130-31e092912897 None admin] PATH_INFO: `/v3/projects/cadcd19b789a4e0b8b02fa150d67316e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:50.303517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64a489-9d39-46f3-8130-31e092912897 None admin] RBAC: Authorizing `identity:get_project(project_id=cadcd19b789a4e0b8b02fa150d67316e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:50.304939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64a489-9d39-46f3-8130-31e092912897 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:50.306498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 603/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:50 2022] GET /identity/v3/projects/cadcd19b789a4e0b8b02fa150d67316e => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:50.313159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:50.407996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb8539-f634-4ed3-9f2a-410b62a23818 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:50.440927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:50.441519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:50.441794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:50.442063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:50.442776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=cadcd19b789a4e0b8b02fa150d67316e, user.id=1a74756fca874317b00cb826310ec271) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:50.443080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:50.444532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24707b-7838-45c6-b904-6b3da9b582ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:50.449738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 582/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:50 2022] GET /identity/v3/role_assignments?user.id=1a74756fca874317b00cb826310ec271&scope.project.id=cadcd19b789a4e0b8b02fa150d67316e&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:52.528623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28075-c2b8-43bf-a74c-5fcb68c7df63 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:52.529174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28075-c2b8-43bf-a74c-5fcb68c7df63 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:52.529174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28075-c2b8-43bf-a74c-5fcb68c7df63 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:52.531011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 604/1186] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:52.536025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:52.536438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:52.536572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:52.554817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:52.556045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:52.569391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:52.621362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 583/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:52.892155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28075-c2b8-43bf-a74c-5fcb68c7df63 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:52.988645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28075-c2b8-43bf-a74c-5fcb68c7df63 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:53.021405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:53.022018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:53.022294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:53.022562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:53.032174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:53.036913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:53.038075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:06:53.039248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 605/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:53.043897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:53.141117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6a791-7886-4d7a-88ad-d74f34a155cc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:53.173549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:53.174142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:53.174420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:53.174690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:53.175338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:53.175638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:53.177014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:53.184748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 584/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:53.190772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:53.206200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:53.286551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253df9-c54c-4243-9b43-7fe20f1f660a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:53.319459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:53.320099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:53.320382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:53.320656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] PATH_INFO: `/v3/users/1a74756fca874317b00cb826310ec271` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:53.321757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] RBAC: Authorizing `identity:get_user(user_id=1a74756fca874317b00cb826310ec271)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:53.323165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:53.324732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 606/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:53 2022] GET /identity/v3/users/1a74756fca874317b00cb826310ec271 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:53.330752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:53.343602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:53.429850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21147fd-3548-4265-94e1-10bba87720d5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:53.462151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a909658-4fa1-4b69-b9f2-f5c87d18854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:53.462765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a909658-4fa1-4b69-b9f2-f5c87d18854d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:53.463048 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a909658-4fa1-4b69-b9f2-f5c87d18854d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:53.463320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a909658-4fa1-4b69-b9f2-f5c87d18854d None admin] PATH_INFO: `/v3/projects/cadcd19b789a4e0b8b02fa150d67316e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:53.464443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a909658-4fa1-4b69-b9f2-f5c87d18854d None admin] RBAC: Authorizing `identity:get_project(project_id=cadcd19b789a4e0b8b02fa150d67316e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:53.465854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a909658-4fa1-4b69-b9f2-f5c87d18854d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:53.467983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 585/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:53 2022] GET /identity/v3/projects/cadcd19b789a4e0b8b02fa150d67316e => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:53.473653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:53.551697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:53.569222 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb0d17-b39f-4517-85f0-29580a840f98 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:53.601834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766075c-11d8-4e6b-8b43-736d38860443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:53.602481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766075c-11d8-4e6b-8b43-736d38860443 None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:53.602755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766075c-11d8-4e6b-8b43-736d38860443 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:53.603023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766075c-11d8-4e6b-8b43-736d38860443 None admin] PATH_INFO: `/v3/projects/cadcd19b789a4e0b8b02fa150d67316e/users/1a74756fca874317b00cb826310ec271/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:53.605197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766075c-11d8-4e6b-8b43-736d38860443 None admin] RBAC: Authorizing `identity:create_grant(project_id=cadcd19b789a4e0b8b02fa150d67316e, user_id=1a74756fca874317b00cb826310ec271, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:53.606607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766075c-11d8-4e6b-8b43-736d38860443 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:53.619323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 607/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:06:53 2022] PUT /identity/v3/projects/cadcd19b789a4e0b8b02fa150d67316e/users/1a74756fca874317b00cb826310ec271/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:06:55.757058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697e0f-45c0-4eb2-8d78-1589b8a629ad None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:55.757617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697e0f-45c0-4eb2-8d78-1589b8a629ad None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:55.757617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697e0f-45c0-4eb2-8d78-1589b8a629ad None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:55.758949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 586/1193] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:06:55.765228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:55.765620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:55.765777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:55.783406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:06:55.784622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:06:55.849186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 608/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:06:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:06:56.117970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697e0f-45c0-4eb2-8d78-1589b8a629ad None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:56.194741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:56.217389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697e0f-45c0-4eb2-8d78-1589b8a629ad None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:56.248890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:56.249504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:56.249781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:56.250052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:56.260207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:06:56.265798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:06:56.266911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:06:56.267793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 587/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:06:56.272792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:56.337557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:56.366660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c23c-0010-4258-999a-295abde8c34f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:56.398747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:56.399279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:56.399553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:56.399818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:56.400491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:56.400791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:56.402122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:56.410196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 609/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:56.415910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:56.512487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05212155-4772-4158-b05c-2ab17353f0e8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:56.545307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:56.545921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:56.546197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:56.546505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] PATH_INFO: `/v3/users/1a74756fca874317b00cb826310ec271` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:56.547586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] RBAC: Authorizing `identity:get_user(user_id=1a74756fca874317b00cb826310ec271)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:56.549021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:56.550558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 588/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Sat Oct 1 04:06:56 2022] GET /identity/v3/users/1a74756fca874317b00cb826310ec271 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:56.556380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:56.651498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c545c1-785a-4782-b9ea-f07e44ef5962 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:56.683336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:56.683918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:56.684216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:56.684482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:56.686944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:56.748317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:56.749738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:56.842636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 610/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:06:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:06:56.848670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:56.858178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:56.945969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07fd1-8160-4b13-8136-8bdde998a168 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:56.978525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf032ed4-fd5f-496c-86ba-6562d7831f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:56.979134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032ed4-fd5f-496c-86ba-6562d7831f44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:56.979412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032ed4-fd5f-496c-86ba-6562d7831f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:56.979683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032ed4-fd5f-496c-86ba-6562d7831f44 None admin] PATH_INFO: `/v3/projects/cadcd19b789a4e0b8b02fa150d67316e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:56.980810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf032ed4-fd5f-496c-86ba-6562d7831f44 None admin] RBAC: Authorizing `identity:get_project(project_id=cadcd19b789a4e0b8b02fa150d67316e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:56.982251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf032ed4-fd5f-496c-86ba-6562d7831f44 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:56.983839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 589/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Sat Oct 1 04:06:56 2022] GET /identity/v3/projects/cadcd19b789a4e0b8b02fa150d67316e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:06:56.989995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:06:57.022158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:06:57.084855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc863a-108e-4392-bc13-b3b88af3a778 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:06:57.116795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:06:57.117383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:06:57.117658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:06:57.117924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:06:57.118632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=cadcd19b789a4e0b8b02fa150d67316e, user.id=1a74756fca874317b00cb826310ec271) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:06:57.118933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:06:57.120358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65caa2-5c59-4c02-9f5c-cddb2b4427e9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:06:57.126354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 611/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:06:56 2022] GET /identity/v3/role_assignments?user.id=1a74756fca874317b00cb826310ec271&scope.project.id=cadcd19b789a4e0b8b02fa150d67316e&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:06.974551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=63 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:07.123929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=51 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:52.438185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a651e-ea67-4e62-aca8-0011db112c2b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:52.438185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a651e-ea67-4e62-aca8-0011db112c2b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:52.438185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a651e-ea67-4e62-aca8-0011db112c2b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:52.438185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 590/1201] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:07:52.445266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:52.445729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:52.445873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:52.470535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:07:52.471993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:07:52.556939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 612/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:07:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 01 04:07:52.855394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a651e-ea67-4e62-aca8-0011db112c2b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:52.976555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a651e-ea67-4e62-aca8-0011db112c2b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:53.019962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:53.020739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:53.021013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:53.021311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:53.034751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:53.036363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:07:53.054122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:07:53.055329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:07:53.056449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:07:53.056449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:07:53.056449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:07:53.059911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 591/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:07:53.063185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:53.192082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e04c9b-ba2e-47aa-b746-40fde38cb941 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:53.227424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:53.236779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:53.237803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:53.238294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:53.238937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:53.239661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:53.240026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:53.241441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8ecba-b1f3-4eb3-b112-4bfc9e67ca7e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:53.256051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 613/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:53.263447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:53.340584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:53.412457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b3561-c997-4721-8c01-6c990982dc00 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:53.461501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b7bd-8e75-4a64-b88d-f60a2d3402df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:53.463077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b7bd-8e75-4a64-b88d-f60a2d3402df None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:53.463462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b7bd-8e75-4a64-b88d-f60a2d3402df None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:53.464381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b7bd-8e75-4a64-b88d-f60a2d3402df None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:53.465151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b7bd-8e75-4a64-b88d-f60a2d3402df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:53.467068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7b7bd-8e75-4a64-b88d-f60a2d3402df None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:53.493643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 592/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Sat Oct 1 04:07:53 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:07:56.053053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea1aa-27df-40ae-91cb-55e0335552d3 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:56.053053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea1aa-27df-40ae-91cb-55e0335552d3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:56.053053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea1aa-27df-40ae-91cb-55e0335552d3 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:56.053053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 614/1206] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:07:56.058835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:56.059226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:56.059445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:56.080396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:07:56.081534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:07:56.169247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 593/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:07:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:07:56.480124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea1aa-27df-40ae-91cb-55e0335552d3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:56.621792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea1aa-27df-40ae-91cb-55e0335552d3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:56.671699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:56.672566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:56.672836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:56.673225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:56.687158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:07:56.692338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:07:56.693354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:07:56.700120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 615/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:07:56.701470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:56.749519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:56.830808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4ee38-1474-4a64-9af9-da56d064b49b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:56.872152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:56.872773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:56.873053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:56.873324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:56.874033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:56.874382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:56.875873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:56.884557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 594/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:56.890521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:56.947227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:57.001593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f40765-bb14-496f-b49f-40707c35190a None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:57.040875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:57.042044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:57.042318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:57.042585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:57.053577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:57.055082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:07:57.073155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:07:57.074418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:07:57.075351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:07:57.075351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:07:57.075351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:07:57.075351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 616/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:07:57.082359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:57.190107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:57.194798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a51b2-bf1e-4cdc-8090-54375f6aaec6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:57.232115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:57.232726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:57.233000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:57.233266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:57.233893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:57.234186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:57.235555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:57.251588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 595/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:57.258734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:57.374761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4a75-13f4-4b8b-96df-b62466d10787 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:57.376530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:57.418414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:57.419188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:57.419555 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:57.419915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:57.428352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:57.430109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:07:57.445967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:07:57.448360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:07:57.449788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:07:57.452885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 617/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:07:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:07:57.454563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:57.585331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd25e-e8fe-4953-b563-71405e68ff97 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:57.630686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:57.631307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:57.631580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:57.631853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:57.632630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:57.632936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:57.634357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:57.656636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 596/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Sat Oct 1 04:07:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:57.662429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:57.785428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0c3ef-89ef-4e99-8e1a-b5007a604e84 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:57.840573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:57.841184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:57.841509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:57.841866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:57.878857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:57.923692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:57.925475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:58.037629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 618/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:07:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:07:58.044096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:58.064564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:58.154870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b77c4-18ff-4bc3-9ad3-5b8e005a5801 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:58.192327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:58.193030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:58.193356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:58.193653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:58.206855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:58.208692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:07:58.226949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:07:58.233281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:07:58.234408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:07:58.234408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:07:58.234408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:07:58.234408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 597/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:07:58.234695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:58.302845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:58.349188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242a62-7289-42fe-8461-cc142ff6d8e8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:58.390270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:58.391027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:58.391311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:58.391606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:58.392292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:58.392616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:58.394076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:58.413069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 619/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:58.414270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:58.494753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:58.539557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9450-4b76-4c3c-aaf6-23de74d848c8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:58.583049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:58.583049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:58.583049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:58.583049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:58.590090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:58.592010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:07:58.607336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:07:58.608544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:07:58.609468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 598/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:07:58.614578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:58.720647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85ad66-1dae-499a-b9d8-60e4dfb73cef None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:58.742966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:58.756110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:58.756719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:58.757000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:58.757271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:58.757953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:58.758260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:58.759677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70574a-57c6-4a85-99dd-6d6b4ce2651b None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:58.771504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 620/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:07:58.778783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:07:58.898688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa911a7-32f3-4f55-a0b6-b89bab296996 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:07:58.933414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:07:58.939652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:07:58.940305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:07:58.940587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:07:58.940864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:07:58.941592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=8c396bae46a64f1b8ca950fb8d7a2770) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:07:58.941901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:07:58.943357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0776b81-1094-4f93-9e23-3bb3c9a4fbfb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:07:58.949749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 599/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:07:58 2022] GET /identity/v3/role_assignments?user.id=8c396bae46a64f1b8ca950fb8d7a2770&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:08:01.304243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5aa6-95a7-4913-bdbd-9b246fc53a51 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:01.304787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5aa6-95a7-4913-bdbd-9b246fc53a51 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:01.304787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5aa6-95a7-4913-bdbd-9b246fc53a51 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:01.306124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 621/1220] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:01.312304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:01.312774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:01.312877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:01.333363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:01.334552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:01.404477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 600/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:01.712497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5aa6-95a7-4913-bdbd-9b246fc53a51 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:01.824051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5aa6-95a7-4913-bdbd-9b246fc53a51 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:01.865808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:01.866412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:01.866687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:01.866958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:01.878870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:08:01.885000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:01.886457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:01.887594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 622/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:01.895033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:02.016866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bd327-7da4-4978-8dc7-cb4fb48f33e5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:02.042823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:02.053888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:02.054507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:02.054781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:02.055051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:02.055710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:02.056039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:02.057456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:02.065226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 601/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:02.070924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:02.119781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:02.184710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e7bd-c1ec-4cdf-bca2-bff3a7757bb6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:02.218683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:02.219321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:02.219581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:02.219849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:02.230504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:02.231962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:02.247100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:02.248265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:02.249194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:02.249194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:02.249194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:02.249194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 623/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:02.254048 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:02.366923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e686-bada-4158-9db5-1115fd0e07cf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:02.404050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:02.405097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:02.405381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:02.405653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:02.406312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:02.406585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:02.407956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:02.420352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 602/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:02.426215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:02.531082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:02.539949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f2b4-42da-43cf-be8c-f52ebc6f5320 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:02.576487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:02.577121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:02.577402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:02.577675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:02.585339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:02.586860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:08:02.599074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:02.600290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:02.601464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:02.602383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 624/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:02.608574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:02.663348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:02.723002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bacc76-8810-464d-b966-9374d2ab2c08 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:02.763376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:02.764039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:02.764395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:02.764584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:02.765313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:02.765617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:02.767074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:02.784957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 603/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Sat Oct 1 04:08:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:02.790833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:02.898422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6cb9-ba2f-4f66-a307-a4d6636f613e None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:02.933797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:02.934402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:02.934759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:02.935043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:02.946782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:02.948777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:02.964188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:02.965564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:02.966781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:02.966781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:02.966781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:02.966781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 625/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:02.974278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:03.085216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c115344-ddc6-46d3-8cb2-951c90a03f0b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:03.087772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:03.124004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:03.124643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:03.124887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:03.125159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:03.125838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:03.126133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:03.127516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:03.139557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 604/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:03.145772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:03.164508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:03.252404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f71e-25b6-49e7-90f6-5e3880c265cc None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:03.292768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:03.293408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:03.293684 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:03.293983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:03.301165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:03.302581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:08:03.314255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:03.315474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:03.316592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 626/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:03.321567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:03.429810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfca4-3d29-42e5-914d-954375fd8d69 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:03.465109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:03.465724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:03.466058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:03.466368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:03.467117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:03.467500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:03.469125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471650-258e-4005-83c9-39a6ecc47ba3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:03.482552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 605/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:08:03.488789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:03.565872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:03.602420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5a12d-da18-42c9-ab83-bd894115f0f9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:03.636633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d51bcd-4d30-4174-b38f-19a7fab641af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:03.637290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51bcd-4d30-4174-b38f-19a7fab641af None admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:03.637566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51bcd-4d30-4174-b38f-19a7fab641af None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:03.637835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d51bcd-4d30-4174-b38f-19a7fab641af None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/8c396bae46a64f1b8ca950fb8d7a2770/roles/35f9a605faf74e59a330a77f96c04d36` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:03.652566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51bcd-4d30-4174-b38f-19a7fab641af None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=8c396bae46a64f1b8ca950fb8d7a2770, role_id=35f9a605faf74e59a330a77f96c04d36)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:03.654287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d51bcd-4d30-4174-b38f-19a7fab641af None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:03.666618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 627/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:08:03 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/8c396bae46a64f1b8ca950fb8d7a2770/roles/35f9a605faf74e59a330a77f96c04d36 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:08:05.958620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861f461-bc0e-4d8d-bbfd-11834982259d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:05.959171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861f461-bc0e-4d8d-bbfd-11834982259d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:05.959284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861f461-bc0e-4d8d-bbfd-11834982259d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:05.960690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 606/1233] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:05.966988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:05.967466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:05.967565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:05.986604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:05.987901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:06.057923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 628/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:06.350978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861f461-bc0e-4d8d-bbfd-11834982259d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:06.379108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:06.464723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861f461-bc0e-4d8d-bbfd-11834982259d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:06.501181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:06.501820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:06.502091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:06.502353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:06.512965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:08:06.517720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:06.518872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:06.519731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 607/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Sat Oct 1 04:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:06.525600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:06.582551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:06.647487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c086-69b6-4632-870d-53cc9668b7f4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:06.688680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:06.689399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:06.689705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:06.690019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:06.690757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:06.691102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:06.692587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:06.701465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 629/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Sat Oct 1 04:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:06.707470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:06.811685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:06.829736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1fb53-5116-4bdd-98ac-e654afbb8b5c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:06.870771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:06.871406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:06.871687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:06.871987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:06.885381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:06.887151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:06.906689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:06.908115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:06.909183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:06.909183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:06.909183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:06.909183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 608/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:06.914927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:07.034081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eabd9-08d7-4786-8c47-f3f89bf9e8c9 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:07.043892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:07.072018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:07.072656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:07.072914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:07.073180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:07.073814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:07.074110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:07.075461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:07.093162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 630/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:07.094354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:07.212178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4960399-4d42-40e5-b541-dee8389fbbe6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:07.247741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:07.248530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:07.249941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:07.249941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:07.252119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:07.258909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:07.261095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:08:07.273021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:07.274292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:07.275329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 609/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:07.280542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:07.396047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675ad8c-7fef-4201-b916-368d4f948059 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:07.434854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:07.435464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:07.435741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:07.436043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:07.436769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:07.437075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:07.438692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:07.458193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 631/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Sat Oct 1 04:08:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:07.464837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:07.586286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c4f38-07f8-4009-aacf-5c33c4758552 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:07.624011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:07.624641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:07.624969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:07.625326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:07.694263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:07.703261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:07.704754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:07.816289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 610/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:08:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:08:07.822658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:07.854296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:07.932207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2f38-e2fb-4644-8f0e-e64eebc90628 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:07.972015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:07.972750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:07.973114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:07.973468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:07.985907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:07.987594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:08.004085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:08.005366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:08.006604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:08.006604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:08.006604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:08.006604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 632/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:08:08.011789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:08.110387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:08.117424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91889e9e-0ff7-4981-9711-27ecc5a90ee8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:08.156928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:08.157512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:08.157784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:08.158050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:08.158682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:08.158978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:08.160384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:08.172637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 611/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:08.178449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:08.272883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:08.300017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be372d-115d-4e2d-8327-8c734829b0a4 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:08.346182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:08.347009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:08.347562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:08.347909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:08.358011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:08.360531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:08:08.373402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:08.374621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:08.375908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 633/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:08:08.380859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:08.503846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a79d9f-5fa6-436f-b285-9de1ce61fdf3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:08.547883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:08.548539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:08.548939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:08.549131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:08.549748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:08.550045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:08.551541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c38851-0e38-4245-936a-f2a100589973 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:08.573606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 612/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:08.574822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:08.708111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecfb3b-cab3-4314-b0ad-f2e1b1a667c0 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:08.742302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:08.742901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:08.743176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:08.743442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:08.744773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] RBAC: Adding query filter params (role.id=35f9a605faf74e59a330a77f96c04d36, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=8c396bae46a64f1b8ca950fb8d7a2770) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:08.745076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:08.746483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882578f-19c9-48a2-ab82-386aa06c080a None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:08.753378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 634/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:08:08 2022] GET /identity/v3/role_assignments?user.id=8c396bae46a64f1b8ca950fb8d7a2770&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=35f9a605faf74e59a330a77f96c04d36 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:11.217667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964983c0-448f-423f-a1c6-625511441057 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:11.218200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964983c0-448f-423f-a1c6-625511441057 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:11.218200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964983c0-448f-423f-a1c6-625511441057 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:11.219575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 613/1247] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:11.225187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:11.225613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:11.225743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:11.232460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:11.244721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:11.246020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:11.322092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 635/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:11.602466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964983c0-448f-423f-a1c6-625511441057 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:11.621792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:11.707047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964983c0-448f-423f-a1c6-625511441057 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:11.742353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:11.742987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:11.743263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:11.743605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:11.754284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:08:11.759571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:11.761069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:11.762138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 614/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:11.767284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:11.868013 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026e8d-9c8d-4010-9e02-28c88fc39c95 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:11.897436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:11.902956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:11.903539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:11.903811 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:11.904114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:11.904766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:11.906983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:11.906983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:11.914571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 636/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:11.920994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:11.995719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:12.018483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4584a-5734-4adb-af5c-270fed297022 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:12.051435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:12.052096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:12.052371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:12.052636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:12.062632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:12.064071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:12.080770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:12.081922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:12.083040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:12.083040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:12.083040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:12.083040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 615/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:12.088565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:12.203863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62872ab-e73d-4e14-a9bc-206165136f04 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:12.235799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:12.236425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:12.236700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:12.236967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:12.237596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:12.237893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:12.239238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:12.250871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 637/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:12.256493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:12.353684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851a4d9-ac3b-4113-80ea-d99ab97dd4d8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:12.378436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:12.386621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:12.387235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:12.387506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:12.387771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:12.394911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:12.396349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:08:12.407584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:12.408722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:12.410084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 616/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:12.414329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:12.467970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:12.513931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796e216-aefa-4803-91ee-0a602f1c00ab None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:12.547661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:12.548292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:12.548689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:12.548877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:12.549541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:12.549843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:12.551275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:12.569923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 638/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Sat Oct 1 04:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:12.576320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:12.678513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f5e74-e3e0-4f6f-a101-9c492e180091 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:12.713013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:12.713601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:12.713877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:12.714145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:12.766332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:12.783186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:12.784682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:12.879206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 617/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:08:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:08:12.885771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:12.979474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0c5f-c06b-475d-ac8f-25ab06cd4249 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:12.991792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:13.013323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:13.013937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:13.014214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:13.014484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:13.024130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:13.025517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:13.039379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:13.040558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:13.041844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:13.041844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:13.041844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:13.041844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 639/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:13.046027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:13.131844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:13.144993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8087f-2be9-457c-a65a-bf33cb1111ff None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:13.178396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:13.178989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:13.179284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:13.179554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:13.180218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:13.180515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:13.181883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:13.192549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 618/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:13.198591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:13.294069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f1d1-d0ae-452c-bfda-4fd0cace76d6 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:13.325667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:13.326274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:13.326550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:13.326819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:13.333123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:13.334538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:08:13.345954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:13.347005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:13.348144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 640/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:13.352531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:13.449012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eb2f2-f46e-4efd-94bf-44527de417e8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:13.481719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:13.482309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:13.482583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:13.482851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:13.483523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:13.483824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:13.485252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d428b26-2a55-46f4-b0b4-8c0c5ce09fc4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:13.497299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 619/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:13.503084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:13.529306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:13.610416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ce9a-d7af-4c26-bf1e-8321ddc9ed7c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:13.641944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:13.642540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:13.642819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:13.643091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:13.643813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=8c396bae46a64f1b8ca950fb8d7a2770) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:13.644143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:13.645556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36246ff8-8dcf-4c09-bc64-ed38015eb159 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:13.651237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 641/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:08:13 2022] GET /identity/v3/role_assignments?user.id=8c396bae46a64f1b8ca950fb8d7a2770&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=8fdee6d92c844466842df5998d45def4 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:15.757276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f4b2-e2df-4e92-b4a9-07688802de4f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:15.757874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f4b2-e2df-4e92-b4a9-07688802de4f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:15.757874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7f4b2-e2df-4e92-b4a9-07688802de4f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:15.759971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 620/1261] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:15.765059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:15.765481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:15.765606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:15.784163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:15.785325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:15.850681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 642/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:16.117804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f4b2-e2df-4e92-b4a9-07688802de4f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:16.129100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:16.218231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7f4b2-e2df-4e92-b4a9-07688802de4f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:16.251032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:16.251648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:16.251925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:16.252223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:16.262240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:08:16.266998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:16.268146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:16.269234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 621/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:16.274188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:16.292202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:16.368942 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938786a-f2bc-4604-ad85-f6da33266ead None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:16.401746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:16.402341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:16.402619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:16.402890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:16.403541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:16.403842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:16.405213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:16.412807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 643/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:16.418445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:16.483490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:16.515945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3bc5-78bc-4b2d-855b-044732fb75f4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:16.552914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:16.553541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:16.553814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:16.554118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:16.565405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:16.566886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:16.581775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:16.583016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:16.584130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:16.584130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:16.584130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:16.584130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 622/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:16.589879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:16.669151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:16.687430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa91c-c9f9-4f89-b8ef-1930f9807cf3 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:16.719363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:16.719975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:16.720251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:16.720523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:16.721151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:16.721449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:16.722793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:16.734454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 644/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:16.740237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:16.840751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb64db-d283-493f-9aa4-422b33fc7a82 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:16.869503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:16.888139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:16.888763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:16.889037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:16.889328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:16.896567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:16.897983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:08:16.908842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:16.909896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:16.910972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 623/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:16.916080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:17.011762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba509c9-19f5-4608-9329-42fb136fe159 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:17.044066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:17.044743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:17.045026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:17.045299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:17.046017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:17.046321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:17.047726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:17.056115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:17.064587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 645/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Sat Oct 1 04:08:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:17.070243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:17.173296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec13d3-5be5-444c-ad9b-de19f71e390b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:17.206272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:17.206892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:17.207169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:17.207437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:17.218223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:17.219654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:17.233388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:17.234493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:17.235589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:17.235589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:17.235589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:17.235589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 624/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 01 04:08:17.240562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:17.335271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013abf-0ddc-47ab-97ff-e7a0449aa564 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:17.366439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:17.367027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:17.367302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:17.367567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:17.368730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:17.369026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:17.370358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:17.380902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 646/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:17.386800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:17.418069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:17.494221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec024b94-3c18-4ad6-b42a-04066201acba None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:17.528327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:17.528992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:17.529220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:17.529492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:17.537527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:17.539344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:08:17.553282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:17.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:17.555685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 625/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:17.560284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:17.617669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:17.657656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc6d32-44b7-41fa-bc91-deba5866e2e8 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:17.689456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:17.690048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:17.690324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:17.690596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:17.691275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:17.691577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:17.693006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c44b-d3b3-4cc1-82f7-0b9257763abb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:17.704848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 647/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:17.710624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:17.798846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:17.809727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532a04-bd5f-4f38-b724-8fa1ce5e4ffe None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:17.843170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372db96-f61d-46c7-a9c0-d4d24c23ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:17.843819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372db96-f61d-46c7-a9c0-d4d24c23ad35 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:17.844132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372db96-f61d-46c7-a9c0-d4d24c23ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:17.844410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372db96-f61d-46c7-a9c0-d4d24c23ad35 None admin] PATH_INFO: `/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/8c396bae46a64f1b8ca950fb8d7a2770/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:17.846238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372db96-f61d-46c7-a9c0-d4d24c23ad35 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f75e1b358f84e6eaa27c44900970892, user_id=8c396bae46a64f1b8ca950fb8d7a2770, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:17.847653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372db96-f61d-46c7-a9c0-d4d24c23ad35 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:17.860275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 626/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Sat Oct 1 04:08:17 2022] PUT /identity/v3/projects/3f75e1b358f84e6eaa27c44900970892/users/8c396bae46a64f1b8ca950fb8d7a2770/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:08:19.965488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0189b38-4078-4081-a6fb-3a6ab5044d94 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:19.966018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0189b38-4078-4081-a6fb-3a6ab5044d94 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:19.966018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0189b38-4078-4081-a6fb-3a6ab5044d94 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:19.967329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 648/1274] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:19.972408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:19.972774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:19.972946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:19.991091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:19.992298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:20.055315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 627/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:20.321925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0189b38-4078-4081-a6fb-3a6ab5044d94 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:20.418881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0189b38-4078-4081-a6fb-3a6ab5044d94 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:20.435036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:20.451018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:20.451629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:20.451902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:20.452201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:20.462262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 01 04:08:20.466987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:20.468091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:20.469281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 649/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Sat Oct 1 04:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:20.473947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:20.557330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:20.580277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4132b-b71d-4282-9e1b-403e4ab5683f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:20.617991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:20.618600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:20.618881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:20.619153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:20.619818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:20.620146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:20.621499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:20.629354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 628/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Sat Oct 1 04:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:20.635609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:20.731417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe70dc-828a-49b8-9f79-c18cdf085598 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:20.763681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:20.764310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:20.764596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:20.764868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:20.775141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:20.776598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:20.790516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:20.791669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:20.792822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:20.792822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:20.792822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:20.792822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 650/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:20.797214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:20.894090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f7db-4969-4ac3-9f1f-727f2f3e85ce None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:20.926501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:20.927091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:20.927364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:20.927632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:20.928280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:20.928577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:20.929924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:20.941536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 629/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:20.947168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:20.976315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:21.042714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70857859-e1b7-4092-a3a3-976722ebfb92 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:21.074234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:21.074844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:21.075119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:21.075389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:21.082392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:21.083804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 01 04:08:21.094987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:21.096152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:21.097141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 651/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:21.101683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:21.106081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:21.198980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e55e14-5b23-413a-b14e-d31d5f63a0cb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:21.231698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:21.232311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:21.232586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:21.232850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:21.233556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:21.233852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:21.235252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:21.251887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 630/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Sat Oct 1 04:08:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:21.257543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:21.347542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:21.356896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98c187-da42-4b79-ac62-110456d5dd85 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:21.389343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:21.389936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:21.390211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:21.390476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:21.453540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:21.454896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:21.541199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:21.551294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 652/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Sat Oct 1 04:08:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 01 04:08:21.557840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:21.617593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:21.656607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f364c-2e29-4953-891b-0359e6e664f3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:21.689047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:21.689669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:21.689946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:21.690218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:21.700494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:21.701923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 01 04:08:21.716235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:21.717414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 01 04:08:21.718412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 01 04:08:21.718412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 01 04:08:21.718412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:21.718412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 631/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:21.722874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:21.817826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8b57-223a-491d-b31c-3733aad81035 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:21.850662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:21.851267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:21.851546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:21.851819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:21.853094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:21.853399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:21.854758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:21.865724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 653/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Sat Oct 1 04:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:21.871513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:21.980794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc8709-6ce3-42a2-9160-1917e4ea96b9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:21.997177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:22.018516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:22.019134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:22.019433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:22.019705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:22.026784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:22.028241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 01 04:08:22.039182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:22.040920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Oct 01 04:08:22.041852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 632/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Sat Oct 1 04:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:22.046822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:22.094790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:22.144303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aa0e3-a376-4172-8133-406f8252d65f None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:22.179618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:22.180289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:22.180567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:22.180843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:22.181525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:22.181828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:22.183235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374fb75-c3fb-41b1-96ed-3dacfe838802 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:22.194494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 654/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Sat Oct 1 04:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:22.201003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:22.299915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87782-14f1-41de-b52b-be48864805e1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:22.337577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:22.338170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:22.338444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:22.338712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:22.339427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] RBAC: Adding query filter params (role.id=8fdee6d92c844466842df5998d45def4, scope.project.id=3f75e1b358f84e6eaa27c44900970892, user.id=8c396bae46a64f1b8ca950fb8d7a2770) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:22.339735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:22.341248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69145b14-a933-471a-b41b-3000364effe3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:22.346819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 633/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Sat Oct 1 04:08:22 2022] GET /identity/v3/role_assignments?user.id=8c396bae46a64f1b8ca950fb8d7a2770&scope.project.id=3f75e1b358f84e6eaa27c44900970892&role.id=8fdee6d92c844466842df5998d45def4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:08:24.465679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59db8-ca9f-4d16-af9d-6d1d9670c6a6 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:24.466224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59db8-ca9f-4d16-af9d-6d1d9670c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:24.466224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59db8-ca9f-4d16-af9d-6d1d9670c6a6 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:24.467540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 655/1288] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:24.472613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:24.473111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:24.473210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:24.491316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:24.493129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:24.521486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:24.565230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 634/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:24.834560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59db8-ca9f-4d16-af9d-6d1d9670c6a6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:24.932341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59db8-ca9f-4d16-af9d-6d1d9670c6a6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:24.942489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:24.966202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:24.966818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:24.967096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:24.967367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:24.967965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:24.969322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:24.978524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:24.979616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:24.980545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 656/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:08:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:24.985577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:25.084862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9502-48c9-42e1-bfdb-07c7672e3cd8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:25.117669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:25.118269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:25.118545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:25.118811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:25.119453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:25.119753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:25.121136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3156a2-8d3c-42e5-9b84-68a9caa8e32e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:25.125732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 635/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Sat Oct 1 04:08:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:25.131762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:25.228051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf776ad-397e-47c5-89c7-b47d89976070 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:25.259879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:25.260490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:25.260769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:25.261039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] PATH_INFO: `/v3/services` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:25.261653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:25.261953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:25.263280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b4f31-26bd-4c00-9e42-b22756aa8e40 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:25.267453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 657/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Sat Oct 1 04:08:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:27.364480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7ac50-da9d-4ca8-84e6-1b18e0573478 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:27.365041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7ac50-da9d-4ca8-84e6-1b18e0573478 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:27.365041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7ac50-da9d-4ca8-84e6-1b18e0573478 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:27.366352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 636/1293] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:27.371742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c776e-dc5b-41d7-a189-e4bf67b78107 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:27.372131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c776e-dc5b-41d7-a189-e4bf67b78107 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:27.372332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c776e-dc5b-41d7-a189-e4bf67b78107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:27.390209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c49c776e-dc5b-41d7-a189-e4bf67b78107 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:27.391385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c49c776e-dc5b-41d7-a189-e4bf67b78107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:27.420477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:27.456344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 658/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:27.720967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7ac50-da9d-4ca8-84e6-1b18e0573478 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:27.752130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:27.821649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7ac50-da9d-4ca8-84e6-1b18e0573478 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:27.855290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73556e-b744-46aa-ab79-b3e584690334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:27.855890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73556e-b744-46aa-ab79-b3e584690334 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:27.856201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73556e-b744-46aa-ab79-b3e584690334 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:27.856474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73556e-b744-46aa-ab79-b3e584690334 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:27.857125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73556e-b744-46aa-ab79-b3e584690334 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:27.858474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73556e-b744-46aa-ab79-b3e584690334 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:27.872393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 637/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Sat Oct 1 04:08:27 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:08:30.000709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37238cb-3650-4c47-9d7b-d8930ee4d663 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:30.001252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37238cb-3650-4c47-9d7b-d8930ee4d663 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:30.001252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37238cb-3650-4c47-9d7b-d8930ee4d663 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:30.002606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 659/1296] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:30.008168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:30.008547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:30.008730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:30.026981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:30.028169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:30.097530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 638/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:30.365498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37238cb-3650-4c47-9d7b-d8930ee4d663 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:30.462346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37238cb-3650-4c47-9d7b-d8930ee4d663 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:30.494919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:30.495531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:30.495810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:30.496108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:30.496685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:30.498020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:30.506494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:30.507752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:30.508741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 660/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:08:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:30.513586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:30.533142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:30.623488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b31241-52f8-4501-973e-f867548fb488 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:30.655726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:30.656358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:30.656638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:30.656909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:30.657523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:30.657823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:30.659182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:30.664665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 639/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Sat Oct 1 04:08:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:30.670785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:30.701391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:30.767069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a038-2aaf-4ed4-a8ca-893fd3e85582 None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:30.798758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:30.799348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:30.799626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:30.799896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:30.800608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] RBAC: Adding query filter params (interface=public, service_id=934f323e54e3492a9fc20149a73a4a8b, region_id=RegionOne) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:30.800912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:30.802254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a847b-ac1a-4540-9637-f154fe265026 None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:30.807220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 661/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Sat Oct 1 04:08:30 2022] GET /identity/v3/endpoints?service_id=934f323e54e3492a9fc20149a73a4a8b&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:30.812893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:30.892515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:30.911156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1154d-bc9b-45ef-98d5-1b9426bfe726 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:30.944156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830599-8f3c-4102-a032-bb551c560d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:30.944748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830599-8f3c-4102-a032-bb551c560d79 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:30.945021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830599-8f3c-4102-a032-bb551c560d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:30.945288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830599-8f3c-4102-a032-bb551c560d79 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:30.945877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41830599-8f3c-4102-a032-bb551c560d79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:30.947224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41830599-8f3c-4102-a032-bb551c560d79 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:30.953729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 640/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Sat Oct 1 04:08:30 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:08:33.063227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3f018-c64b-4c1d-bb95-7ef1dbb428a4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:33.063741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3f018-c64b-4c1d-bb95-7ef1dbb428a4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:33.063852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3f018-c64b-4c1d-bb95-7ef1dbb428a4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:33.065103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 662/1302] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:08:33.070300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:33.070667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:33.070839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:33.088937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:08:33.090044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:08:33.153291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 641/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:08:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 01 04:08:33.417015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3f018-c64b-4c1d-bb95-7ef1dbb428a4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:33.507202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:33.514257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3f018-c64b-4c1d-bb95-7ef1dbb428a4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:33.546570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:33.547183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:33.547456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:33.547725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:33.548325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:33.549660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 01 04:08:33.558727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 01 04:08:33.559737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.get_or_create( Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application with Lock( Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self._enter() Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application return self.creator() Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application created_value = creator( Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: ERROR keystone.server.flask.application Oct 01 04:08:33.560710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 663/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Sat Oct 1 04:08:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 01 04:08:33.565700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:33.638965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:33.661789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be3466-a65b-4565-b2c5-a3871a790e82 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:33.693674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:33.694205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:33.694475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:33.694738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:33.695847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:08:33.696167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:33.697506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc970-870d-4454-b0f3-a96fb15a9e93 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:33.702410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 642/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Sat Oct 1 04:08:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:08:33.708061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:08:33.804953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0fc3-5356-469d-a3af-2470c594929c None admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:08:33.839761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf8f6-a3de-4008-8862-3b8ec525fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:08:33.840402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf8f6-a3de-4008-8862-3b8ec525fedb None admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:08:33.840685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf8f6-a3de-4008-8862-3b8ec525fedb None admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:08:33.840961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf8f6-a3de-4008-8862-3b8ec525fedb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:08:33.841634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf8f6-a3de-4008-8862-3b8ec525fedb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:08:33.842993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf8f6-a3de-4008-8862-3b8ec525fedb None admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:08:33.861440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 664/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:08:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:08:43.699571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=30 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:08:43.857679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:37.244704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12b43-4c0a-4397-92d6-c3a9490021ed None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:37.245821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12b43-4c0a-4397-92d6-c3a9490021ed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:37.246400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12b43-4c0a-4397-92d6-c3a9490021ed None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:37.256808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ba2f0-15b8-46e9-8f97-ddc89950c8cb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:37.258218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ba2f0-15b8-46e9-8f97-ddc89950c8cb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:37.258678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ba2f0-15b8-46e9-8f97-ddc89950c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:37.261862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 643/1307] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:37 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:37.361570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d22ba2f0-15b8-46e9-8f97-ddc89950c8cb None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:37.363341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d22ba2f0-15b8-46e9-8f97-ddc89950c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:37.509134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 665/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:37.802326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faf5bd-b732-471a-955a-1ea4919554e3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:37.802608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faf5bd-b732-471a-955a-1ea4919554e3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:37.803108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faf5bd-b732-471a-955a-1ea4919554e3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:37.804757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 644/1309] 10.222.0.27 () {54 vars in 964 bytes} [Sat Oct 1 04:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:37.811223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ce59-8f73-4fcf-b1f2-b8f0a8eab24a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:37.811512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ce59-8f73-4fcf-b1f2-b8f0a8eab24a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:37.811785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ce59-8f73-4fcf-b1f2-b8f0a8eab24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:37.903349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-89a5ce59-8f73-4fcf-b1f2-b8f0a8eab24a None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:37.904662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-89a5ce59-8f73-4fcf-b1f2-b8f0a8eab24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:37.928800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:37.994964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 666/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Sat Oct 1 04:09:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:38.004832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faf5bd-b732-471a-955a-1ea4919554e3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:38.006883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0faf5bd-b732-471a-955a-1ea4919554e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:38.122156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faf5bd-b732-471a-955a-1ea4919554e3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:38.200030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:38.200643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:38.200915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:38.201181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:38.202755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:38.259095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:38.319362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:38.320708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74fba5-4dae-401f-909f-12cbf9aa4138 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:38.339676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 645/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:09:40.794402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901cb1-e9e3-4b79-8f7b-225ce214ba68 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:40.794951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901cb1-e9e3-4b79-8f7b-225ce214ba68 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:40.795059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901cb1-e9e3-4b79-8f7b-225ce214ba68 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:40.796388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 667/1312] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:40.801696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa638a4-1123-4e92-bbe5-617ccda759d9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:40.802078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa638a4-1123-4e92-bbe5-617ccda759d9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:40.802240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa638a4-1123-4e92-bbe5-617ccda759d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:40.874227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-baa638a4-1123-4e92-bbe5-617ccda759d9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:40.875436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-baa638a4-1123-4e92-bbe5-617ccda759d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:40.969756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 646/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:41.251640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08901cb1-e9e3-4b79-8f7b-225ce214ba68 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:41.253470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-08901cb1-e9e3-4b79-8f7b-225ce214ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:41.362415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08901cb1-e9e3-4b79-8f7b-225ce214ba68 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:41.437269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:41.440833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:41.441683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:41.442175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:41.442673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:41.444308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:41.554603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:41.556065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73f5a2-5b40-4b75-9726-e3597a9faf2c service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:41.574066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 668/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:09:43.999477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3439-8f8f-4a1d-9f56-90c23be314ec None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:44.000019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3439-8f8f-4a1d-9f56-90c23be314ec None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:44.000151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3439-8f8f-4a1d-9f56-90c23be314ec None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:44.001373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 647/1315] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:44.007280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93af16-a137-4566-8b93-65c89ce5a9b1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:44.007703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93af16-a137-4566-8b93-65c89ce5a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:44.007798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93af16-a137-4566-8b93-65c89ce5a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:44.072935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-de93af16-a137-4566-8b93-65c89ce5a9b1 None None] MFA Rules not processed for user `6e0dc09ddedf4d0e950ee4460e0bc2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:44.074139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-de93af16-a137-4566-8b93-65c89ce5a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:44.124635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:44.168105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 669/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:44.451729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba3439-8f8f-4a1d-9f56-90c23be314ec None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:44.453301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-89ba3439-8f8f-4a1d-9f56-90c23be314ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:44.463426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:44.557500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba3439-8f8f-4a1d-9f56-90c23be314ec None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:44.629270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:44.629874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:44.630151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:44.630426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:44.632297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:44.695003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:44.746119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:44.747541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cb350-e6bc-43c9-a1dc-cf1bf482002a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:44.765992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 648/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:09:47.443892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2450-de57-4ba5-932f-acf452054cb2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:47.444452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2450-de57-4ba5-932f-acf452054cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:47.444452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2450-de57-4ba5-932f-acf452054cb2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:47.445807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 670/1318] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:47.451198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2826-2bd8-45fc-9175-1c0d71835048 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:47.451598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2826-2bd8-45fc-9175-1c0d71835048 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:47.451750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2826-2bd8-45fc-9175-1c0d71835048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:47.516187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b4af2826-2bd8-45fc-9175-1c0d71835048 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:47.517381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b4af2826-2bd8-45fc-9175-1c0d71835048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:47.612411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 649/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:47.902582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2450-de57-4ba5-932f-acf452054cb2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:47.904149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-372e2450-de57-4ba5-932f-acf452054cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:48.006984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2450-de57-4ba5-932f-acf452054cb2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:48.077738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:48.078275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:48.078550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:48.078820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:48.080457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:48.087903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:48.186289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:48.187708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f0d47-3119-4605-b91d-b4b2746a5b65 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:48.206058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 671/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:09:50.984956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d40ec-6595-41f5-a056-c215651ad9a4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:50.985470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d40ec-6595-41f5-a056-c215651ad9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:50.985561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d40ec-6595-41f5-a056-c215651ad9a4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:50.987477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 650/1321] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:50.992833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6788b-2846-4022-af8e-45b7879a2523 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:50.993277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6788b-2846-4022-af8e-45b7879a2523 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:50.993420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6788b-2846-4022-af8e-45b7879a2523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:51.066847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-faa6788b-2846-4022-af8e-45b7879a2523 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:51.068114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-faa6788b-2846-4022-af8e-45b7879a2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:51.131320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:51.174364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 672/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:51.455503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d40ec-6595-41f5-a056-c215651ad9a4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:51.457112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f03d40ec-6595-41f5-a056-c215651ad9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:51.477223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:51.564187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d40ec-6595-41f5-a056-c215651ad9a4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:51.640508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:51.641153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:51.641430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:51.641702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:51.643304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:51.716399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:51.754968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:51.756722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc1baa-9c77-41e0-a97f-e77f168befd8 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:51.775321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 651/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:09:53.985159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30967d-ad4a-4319-b49f-9ec872821e33 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:53.985748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30967d-ad4a-4319-b49f-9ec872821e33 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:53.985748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30967d-ad4a-4319-b49f-9ec872821e33 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:53.987034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 673/1324] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:53.992466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d47ab-379c-4e23-b998-3ae9d32d94a8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:53.992889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d47ab-379c-4e23-b998-3ae9d32d94a8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:53.992991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d47ab-379c-4e23-b998-3ae9d32d94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:54.059437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c41d47ab-379c-4e23-b998-3ae9d32d94a8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:54.060679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c41d47ab-379c-4e23-b998-3ae9d32d94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:54.165292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 652/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:54.446958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30967d-ad4a-4319-b49f-9ec872821e33 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:54.448589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9e30967d-ad4a-4319-b49f-9ec872821e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:54.551946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30967d-ad4a-4319-b49f-9ec872821e33 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:54.625596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:54.626220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:54.626503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:54.626771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:54.628388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:54.645264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:54.738042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:54.739466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fb7c-7381-4ad4-8c58-404fc4cf969d service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:54.757783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 674/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:09:56.979081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcc0e-4788-441f-93a3-62b17e366283 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:56.979622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcc0e-4788-441f-93a3-62b17e366283 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:56.979622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dcc0e-4788-441f-93a3-62b17e366283 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:56.983960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 653/1327] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:09:56.987514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d92f-8b4c-4b25-81ed-db3e5d3c42b9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:56.988017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d92f-8b4c-4b25-81ed-db3e5d3c42b9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:56.988237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d92f-8b4c-4b25-81ed-db3e5d3c42b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:57.058573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4581d92f-8b4c-4b25-81ed-db3e5d3c42b9 None None] MFA Rules not processed for user `6e0dc09ddedf4d0e950ee4460e0bc2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:09:57.059790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4581d92f-8b4c-4b25-81ed-db3e5d3c42b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:57.124661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:57.158214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 675/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:09:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:09:57.444809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dcc0e-4788-441f-93a3-62b17e366283 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:09:57.446354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fd1dcc0e-4788-441f-93a3-62b17e366283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:57.480034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:57.557937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dcc0e-4788-441f-93a3-62b17e366283 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:09:57.633400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:09:57.634004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:09:57.634281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:09:57.634551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:09:57.636164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:09:57.713755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:09:57.746221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:09:57.747652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95535d61-8ae4-47b8-b426-26e45046a319 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:09:57.771134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 654/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:09:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:00.125148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382d9fd-c212-43f5-ac52-eba2d25634d4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:00.125673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382d9fd-c212-43f5-ac52-eba2d25634d4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:00.125673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382d9fd-c212-43f5-ac52-eba2d25634d4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:00.127492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 676/1330] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:00.132925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becfcd-9893-403d-b7b2-9565beef35b8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:00.133346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becfcd-9893-403d-b7b2-9565beef35b8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:00.133506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7becfcd-9893-403d-b7b2-9565beef35b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:00.198180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b7becfcd-9893-403d-b7b2-9565beef35b8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:00.199389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b7becfcd-9893-403d-b7b2-9565beef35b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:00.293799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 655/1331] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:00.574518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382d9fd-c212-43f5-ac52-eba2d25634d4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:00.576068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4382d9fd-c212-43f5-ac52-eba2d25634d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:00.677560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382d9fd-c212-43f5-ac52-eba2d25634d4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:00.751219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:00.751864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:00.752173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:00.752449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:00.754110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:00.781124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:00.863946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:00.865378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a487b5b-78de-4bcb-bac3-a945680a721e service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:00.884062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 677/1332] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:03.064998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a72d-2532-40bb-abcf-3ccf575a2900 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:03.065592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a72d-2532-40bb-abcf-3ccf575a2900 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:03.065592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a72d-2532-40bb-abcf-3ccf575a2900 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:03.066894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 656/1333] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:03.072635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389827b-759e-44e5-afad-5c0248e49da0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:03.073009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389827b-759e-44e5-afad-5c0248e49da0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:03.073266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389827b-759e-44e5-afad-5c0248e49da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:03.138146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f389827b-759e-44e5-afad-5c0248e49da0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:03.139354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f389827b-759e-44e5-afad-5c0248e49da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:03.212932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:03.234506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 678/1334] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:03.521488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a72d-2532-40bb-abcf-3ccf575a2900 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:03.523030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-96b8a72d-2532-40bb-abcf-3ccf575a2900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:03.564592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:03.628445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a72d-2532-40bb-abcf-3ccf575a2900 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:03.702315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:03.702926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:03.703316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:03.703603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:03.705823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:03.789055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:03.816711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:03.818149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1af71-a4fb-46ec-a19d-1b30264774c7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:03.836408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 657/1335] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:06.290659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e8d41-74e3-4ce8-9c6b-65e8171db042 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:06.291203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e8d41-74e3-4ce8-9c6b-65e8171db042 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:06.291203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e8d41-74e3-4ce8-9c6b-65e8171db042 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:06.292560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 679/1336] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:06.297617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9153830-6878-46c3-94cc-19038fbb110b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:06.298051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9153830-6878-46c3-94cc-19038fbb110b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:06.298155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9153830-6878-46c3-94cc-19038fbb110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:06.368899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e9153830-6878-46c3-94cc-19038fbb110b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:06.370300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e9153830-6878-46c3-94cc-19038fbb110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:06.465531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 658/1337] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:06.744822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e8d41-74e3-4ce8-9c6b-65e8171db042 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:06.746436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-017e8d41-74e3-4ce8-9c6b-65e8171db042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:06.849576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e8d41-74e3-4ce8-9c6b-65e8171db042 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:06.922078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:06.922743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:06.923015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:06.923284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:06.924889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:06.958790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:07.029855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:07.031258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d551bc-21c2-4116-8b70-45f81e98bd26 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:07.049369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 680/1338] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:11.073504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bca4-6c08-4f7e-a37f-c4bae423d169 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:11.074029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bca4-6c08-4f7e-a37f-c4bae423d169 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:11.074029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039bca4-6c08-4f7e-a37f-c4bae423d169 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:11.075554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 659/1339] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:11.081382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4836878-0143-4e4d-9ce6-453e071e0162 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:11.081819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4836878-0143-4e4d-9ce6-453e071e0162 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:11.082001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4836878-0143-4e4d-9ce6-453e071e0162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:11.147433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b4836878-0143-4e4d-9ce6-453e071e0162 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:11.148581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4836878-0143-4e4d-9ce6-453e071e0162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:11.232146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:11.243626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 681/1340] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:11.527623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bca4-6c08-4f7e-a37f-c4bae423d169 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:11.529204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5039bca4-6c08-4f7e-a37f-c4bae423d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:11.578864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:11.635790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039bca4-6c08-4f7e-a37f-c4bae423d169 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:11.709079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:11.709687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:11.709964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:11.710233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:11.711818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:11.809939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:11.827340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:11.828892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7db50-5b76-4329-ac9f-1b6b8da5106c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:11.847923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 660/1341] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:14.657330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2babe-aad0-4c24-8b59-74ca3735e28a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:14.657866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2babe-aad0-4c24-8b59-74ca3735e28a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:14.657866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2babe-aad0-4c24-8b59-74ca3735e28a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:14.659390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 682/1342] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:14.664360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbce6a2-5768-475a-a94b-0171af6ecbeb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:14.664745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbce6a2-5768-475a-a94b-0171af6ecbeb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:14.665055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbce6a2-5768-475a-a94b-0171af6ecbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:14.732261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-edbce6a2-5768-475a-a94b-0171af6ecbeb None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:14.733463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-edbce6a2-5768-475a-a94b-0171af6ecbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:14.834842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 661/1343] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:15.119419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2babe-aad0-4c24-8b59-74ca3735e28a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:15.121060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8ea2babe-aad0-4c24-8b59-74ca3735e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:15.227641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2babe-aad0-4c24-8b59-74ca3735e28a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:15.299872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:15.300541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:15.300814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:15.301080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:15.302655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:15.346481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:15.413816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:15.415238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313157c1-0f5f-4446-a492-13e965a3dce6 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:15.433925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 683/1344] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:19.547851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87e0d-3537-4f1d-9bdb-bcc60c4e117c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:19.548362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87e0d-3537-4f1d-9bdb-bcc60c4e117c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:19.548495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87e0d-3537-4f1d-9bdb-bcc60c4e117c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:19.549759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 662/1345] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:19.555483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a9d4e-0817-47b8-a3ca-5ff453e95969 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:19.555976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a9d4e-0817-47b8-a3ca-5ff453e95969 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:19.556129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a9d4e-0817-47b8-a3ca-5ff453e95969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:19.623196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a93a9d4e-0817-47b8-a3ca-5ff453e95969 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:19.624460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a93a9d4e-0817-47b8-a3ca-5ff453e95969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:19.718729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:19.721153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 684/1346] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:19.999926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87e0d-3537-4f1d-9bdb-bcc60c4e117c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:20.001482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7aa87e0d-3537-4f1d-9bdb-bcc60c4e117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:20.058135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:20.104259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87e0d-3537-4f1d-9bdb-bcc60c4e117c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:20.176153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:20.176753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:20.177025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:20.177292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:20.178863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:20.282391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:20.286570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:20.288021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78d0f9-6071-45ad-b452-a713ab7d58b7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:20.306339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 663/1347] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:25.247266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896b9e6-7e85-47dc-9b9b-2ecbf60d70f4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:25.247801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896b9e6-7e85-47dc-9b9b-2ecbf60d70f4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:25.247801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896b9e6-7e85-47dc-9b9b-2ecbf60d70f4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:25.250085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 685/1348] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:25.255602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e68f1-7281-4edc-a795-106ed6cf3070 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:25.256068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e68f1-7281-4edc-a795-106ed6cf3070 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:25.256250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e68f1-7281-4edc-a795-106ed6cf3070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:25.383409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-307e68f1-7281-4edc-a795-106ed6cf3070 None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:25.384581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-307e68f1-7281-4edc-a795-106ed6cf3070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:25.500946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 664/1349] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:10:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:29.506828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7858ca0-6ac4-48fd-9f40-260db5fb515a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:29.507369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7858ca0-6ac4-48fd-9f40-260db5fb515a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:29.507623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7858ca0-6ac4-48fd-9f40-260db5fb515a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:29.509328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 686/1350] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:29.514761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5685f1-cfa9-4ce8-a7d6-4feed3e215ff None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:29.515198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5685f1-cfa9-4ce8-a7d6-4feed3e215ff None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:29.515310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5685f1-cfa9-4ce8-a7d6-4feed3e215ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:29.573188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:29.598354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6d5685f1-cfa9-4ce8-a7d6-4feed3e215ff None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:29.599544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6d5685f1-cfa9-4ce8-a7d6-4feed3e215ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:29.710844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 665/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:10:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:31.240940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16c799-471f-426d-a408-737d2cc14eff None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:31.241909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16c799-471f-426d-a408-737d2cc14eff None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:31.242206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16c799-471f-426d-a408-737d2cc14eff None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:31.243508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 687/1352] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:31.249569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba6e9-5084-4506-8c8f-38646df5f35d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:31.250023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba6e9-5084-4506-8c8f-38646df5f35d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:31.250154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba6e9-5084-4506-8c8f-38646df5f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:31.328861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a7fba6e9-5084-4506-8c8f-38646df5f35d None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:31.330065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a7fba6e9-5084-4506-8c8f-38646df5f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:31.372565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:31.437518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 666/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:34.973001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fe5fd-3707-4921-a9d4-a9f5545bd778 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:34.973524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fe5fd-3707-4921-a9d4-a9f5545bd778 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:34.973524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fe5fd-3707-4921-a9d4-a9f5545bd778 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:34.974763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 688/1354] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:34.980050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e031328-2ac1-43dd-b313-4267bcc94d22 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:34.980457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e031328-2ac1-43dd-b313-4267bcc94d22 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:34.980608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e031328-2ac1-43dd-b313-4267bcc94d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:35.053166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7e031328-2ac1-43dd-b313-4267bcc94d22 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:35.054370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7e031328-2ac1-43dd-b313-4267bcc94d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:35.156495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 667/1355] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:35.463828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92504a5-a418-4e32-a7ee-711fe4d22251 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:35.464651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92504a5-a418-4e32-a7ee-711fe4d22251 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:35.465162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92504a5-a418-4e32-a7ee-711fe4d22251 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:35.466697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 689/1356] 10.222.0.27 () {54 vars in 961 bytes} [Sat Oct 1 04:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 01 04:10:35.475981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d44e8-8756-4c2b-9862-b15358f4d130 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:35.476442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d44e8-8756-4c2b-9862-b15358f4d130 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:35.476872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d44e8-8756-4c2b-9862-b15358f4d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:35.497372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:35.564931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7a7d44e8-8756-4c2b-9862-b15358f4d130 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:35.566134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a7d44e8-8756-4c2b-9862-b15358f4d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:35.689177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 668/1357] 10.222.0.27 () {58 vars in 1058 bytes} [Sat Oct 1 04:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:35.697131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92504a5-a418-4e32-a7ee-711fe4d22251 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:35.698670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e92504a5-a418-4e32-a7ee-711fe4d22251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:35.866080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92504a5-a418-4e32-a7ee-711fe4d22251 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:35.944933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:36.006963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:36.007707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:36.008002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:36.008268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:36.009846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:36.115635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:36.117360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819e705-415b-4f2e-8c45-0d6b99f7a1d5 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:36.137413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 690/1358] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:38.525698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5de1f-8b7a-401b-8a7d-d2353eaa03f0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:38.526315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5de1f-8b7a-401b-8a7d-d2353eaa03f0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:38.526315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5de1f-8b7a-401b-8a7d-d2353eaa03f0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:38.527737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 669/1359] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:38.533042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b8ea2-7ecf-459a-8a31-4c8641cacc38 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:38.533042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b8ea2-7ecf-459a-8a31-4c8641cacc38 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:38.533042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b8ea2-7ecf-459a-8a31-4c8641cacc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:38.603542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-066b8ea2-7ecf-459a-8a31-4c8641cacc38 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:38.604790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-066b8ea2-7ecf-459a-8a31-4c8641cacc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:38.645071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:38.708402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 691/1360] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:39.000378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5de1f-8b7a-401b-8a7d-d2353eaa03f0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:39.002188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0b5de1f-8b7a-401b-8a7d-d2353eaa03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:39.081967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:39.200463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5de1f-8b7a-401b-8a7d-d2353eaa03f0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:39.339345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:39.340033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:39.340306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:39.340574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:39.342190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:39.365541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:39.435053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:39.437331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b5566-b6aa-411a-bc80-530565c7f576 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:39.455585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 670/1361] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:41.937532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af1f15-da4e-4234-840a-0018b1e958b9 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:41.938353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af1f15-da4e-4234-840a-0018b1e958b9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:41.938778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af1f15-da4e-4234-840a-0018b1e958b9 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:41.940282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 692/1362] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:41.945648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6fd93-686a-46c3-babc-76104124a3b8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:41.946085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6fd93-686a-46c3-babc-76104124a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:41.946180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6fd93-686a-46c3-babc-76104124a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:42.016565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c5a6fd93-686a-46c3-babc-76104124a3b8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:42.017768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c5a6fd93-686a-46c3-babc-76104124a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:42.124262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:42.135163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 671/1363] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:42.418010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2098-9b38-482a-be66-5f843fd9c17f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:42.418406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2098-9b38-482a-be66-5f843fd9c17f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:42.418920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2098-9b38-482a-be66-5f843fd9c17f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:42.421121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 693/1364] 10.222.0.27 () {54 vars in 961 bytes} [Sat Oct 1 04:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:42.426450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0ecd-f773-4b5a-aa2b-ce7e11f6b7dc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:42.426738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0ecd-f773-4b5a-aa2b-ce7e11f6b7dc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:42.427011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec0ecd-f773-4b5a-aa2b-ce7e11f6b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:42.505153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-62ec0ecd-f773-4b5a-aa2b-ce7e11f6b7dc None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:42.506448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-62ec0ecd-f773-4b5a-aa2b-ce7e11f6b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:42.627348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 672/1365] 10.222.0.27 () {58 vars in 1058 bytes} [Sat Oct 1 04:10:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:42.635607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2098-9b38-482a-be66-5f843fd9c17f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:42.637138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0ffa2098-9b38-482a-be66-5f843fd9c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:42.792863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2098-9b38-482a-be66-5f843fd9c17f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:42.817888 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:42.922994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:42.923784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:42.924189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:42.924561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:42.926315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:43.025490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:43.027257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679deb4-51f0-4241-bb7b-29206b70ebd7 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:43.047027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 694/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:43.113541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a23b-29f8-4481-94ac-32b817c279f9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:43.114020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a23b-29f8-4481-94ac-32b817c279f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:43.114525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a23b-29f8-4481-94ac-32b817c279f9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:43.116177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 673/1367] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:43.121520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fab2-0d2d-4d90-9cf3-92c34ed56c92 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:43.121991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fab2-0d2d-4d90-9cf3-92c34ed56c92 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:43.122274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5fab2-0d2d-4d90-9cf3-92c34ed56c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:43.158872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:43.201864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4ac5fab2-0d2d-4d90-9cf3-92c34ed56c92 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:43.203157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ac5fab2-0d2d-4d90-9cf3-92c34ed56c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:43.332094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 695/1368] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:43.630333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fb2c-9748-4388-99a3-7679401a086e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:43.630752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fb2c-9748-4388-99a3-7679401a086e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:43.631034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3fb2c-9748-4388-99a3-7679401a086e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:43.632759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 674/1369] 10.222.0.27 () {54 vars in 963 bytes} [Sat Oct 1 04:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:43.637920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b465cb-bf27-4df4-a64c-a6d2480d276a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:43.638747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b465cb-bf27-4df4-a64c-a6d2480d276a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:43.639026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b465cb-bf27-4df4-a64c-a6d2480d276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:43.718465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c9b465cb-bf27-4df4-a64c-a6d2480d276a None None] MFA Rules not processed for user `d1c891f90f1b4b508752dfebc1de3589`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:43.719668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c9b465cb-bf27-4df4-a64c-a6d2480d276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:43.767960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:43.813686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 696/1370] 10.222.0.27 () {58 vars in 1060 bytes} [Sat Oct 1 04:10:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:43.821959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3fb2c-9748-4388-99a3-7679401a086e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:43.823711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2fd3fb2c-9748-4388-99a3-7679401a086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:43.886675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:43.943557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3fb2c-9748-4388-99a3-7679401a086e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:44.023590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:44.024255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:44.024532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:44.024801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:44.026553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:44.143918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:44.161161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:44.162614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f123b99-fa30-40ca-8337-1cd8dac4b8bc service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:44.188294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 675/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:45.318044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303d58-094d-49cf-a02f-145376ed5fda None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:45.318580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303d58-094d-49cf-a02f-145376ed5fda None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:45.318580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303d58-094d-49cf-a02f-145376ed5fda None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:45.319915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 697/1372] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:45.325154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241c34c-aec0-4034-be07-d405466b5898 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:45.325564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241c34c-aec0-4034-be07-d405466b5898 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:45.325743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241c34c-aec0-4034-be07-d405466b5898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:45.393175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c241c34c-aec0-4034-be07-d405466b5898 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:45.394389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c241c34c-aec0-4034-be07-d405466b5898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:45.491031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 676/1373] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:45.788756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303d58-094d-49cf-a02f-145376ed5fda None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:45.790320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-14303d58-094d-49cf-a02f-145376ed5fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:45.954152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303d58-094d-49cf-a02f-145376ed5fda None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:46.006720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:46.071882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:46.072527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:46.072807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:46.073073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:46.074670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:46.168556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:46.169848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7504c-a46d-46a8-8f60-19e32fe8c665 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:46.189136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 698/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:48.394490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b072c5-be6d-4f44-9342-a96429370085 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:48.395023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b072c5-be6d-4f44-9342-a96429370085 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:48.395023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b072c5-be6d-4f44-9342-a96429370085 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:48.396581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 677/1375] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:48.401732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eaf56-3007-4794-ba38-d8d976c3ba3f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:48.402162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eaf56-3007-4794-ba38-d8d976c3ba3f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:48.402330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7eaf56-3007-4794-ba38-d8d976c3ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:48.471196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-de7eaf56-3007-4794-ba38-d8d976c3ba3f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:48.472572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-de7eaf56-3007-4794-ba38-d8d976c3ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:48.482231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:48.580573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 699/1376] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:48.868000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b072c5-be6d-4f44-9342-a96429370085 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:48.871199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-67b072c5-be6d-4f44-9342-a96429370085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:48.938478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:49.030661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b072c5-be6d-4f44-9342-a96429370085 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:49.149996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:49.150612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:49.150889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:49.151159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:49.152806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:49.174036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:49.262271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:49.263921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05129-c22a-44ba-aa0b-715ab956b422 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:49.284812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 678/1377] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:51.496852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef2ba2-c2ed-4355-a16c-1c97eed9b693 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:51.497360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef2ba2-c2ed-4355-a16c-1c97eed9b693 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:51.497455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef2ba2-c2ed-4355-a16c-1c97eed9b693 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:51.498779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 700/1378] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:51.504488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dda1ae-5450-442e-aea0-56c2988779b6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:51.504910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dda1ae-5450-442e-aea0-56c2988779b6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:51.505219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dda1ae-5450-442e-aea0-56c2988779b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:51.602514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-10dda1ae-5450-442e-aea0-56c2988779b6 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:51.604603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-10dda1ae-5450-442e-aea0-56c2988779b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:51.728510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:51.735694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 679/1379] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:52.042689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef2ba2-c2ed-4355-a16c-1c97eed9b693 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:52.044830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-35ef2ba2-c2ed-4355-a16c-1c97eed9b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:52.193531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:52.208470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef2ba2-c2ed-4355-a16c-1c97eed9b693 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:52.322459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:52.323001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:52.323271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:52.323539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:52.326134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:52.418335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:52.420045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84103819-fe5d-478d-b3a4-ad287e7b4b5b service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:52.430088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:52.439621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 701/1380] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:54.694239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba593b2e-f5f2-44fd-a625-2ad9dee21195 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:54.694912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba593b2e-f5f2-44fd-a625-2ad9dee21195 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:54.694912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba593b2e-f5f2-44fd-a625-2ad9dee21195 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:54.696190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 680/1381] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:54.702327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d6bb-25ff-42ad-824f-37c5d26bb9a5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:54.702889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d6bb-25ff-42ad-824f-37c5d26bb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:54.702889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473d6bb-25ff-42ad-824f-37c5d26bb9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:54.768902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4473d6bb-25ff-42ad-824f-37c5d26bb9a5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:54.770101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4473d6bb-25ff-42ad-824f-37c5d26bb9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:54.870957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 702/1382] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:55.180212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba593b2e-f5f2-44fd-a625-2ad9dee21195 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:55.181793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ba593b2e-f5f2-44fd-a625-2ad9dee21195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:55.355390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba593b2e-f5f2-44fd-a625-2ad9dee21195 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:55.437087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:55.484400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:55.485010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:55.485284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:55.485553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:55.487181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:55.584723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:55.586876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dad18e-3eba-4295-be0b-6b920f9587f7 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:55.610267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 681/1383] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:58.094891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc40fa4-31e7-43b0-8efc-07f6f64e6deb None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:58.095445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc40fa4-31e7-43b0-8efc-07f6f64e6deb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:58.095445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc40fa4-31e7-43b0-8efc-07f6f64e6deb None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:58.096683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 703/1384] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:58.101808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d164-ac2e-4b85-9f15-d7d998357d27 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:58.102234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d164-ac2e-4b85-9f15-d7d998357d27 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:58.102360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4d164-ac2e-4b85-9f15-d7d998357d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:58.171788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-18f4d164-ac2e-4b85-9f15-d7d998357d27 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:58.173022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-18f4d164-ac2e-4b85-9f15-d7d998357d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:58.205757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:58.269806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 682/1385] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:10:58.555127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc40fa4-31e7-43b0-8efc-07f6f64e6deb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:10:58.556652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9bc40fa4-31e7-43b0-8efc-07f6f64e6deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:58.631138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:58.701070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc40fa4-31e7-43b0-8efc-07f6f64e6deb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:10:58.812078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:10:58.812614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:58.812891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:58.813162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:58.814745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:58.854797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:58.911989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:10:58.913570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3cc0a-faf4-408a-a846-34691092b766 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:10:58.931668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 704/1386] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:10:59.412561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c2d24-18a3-438c-8d75-ed9e8af8f4c5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:59.413109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c2d24-18a3-438c-8d75-ed9e8af8f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:59.413109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c2d24-18a3-438c-8d75-ed9e8af8f4c5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:59.414457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 683/1387] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:59.420423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef1eb0-292e-4d21-8f86-68ffd3a12d19 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:59.420853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef1eb0-292e-4d21-8f86-68ffd3a12d19 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:59.421121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef1eb0-292e-4d21-8f86-68ffd3a12d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:59.486872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9cef1eb0-292e-4d21-8f86-68ffd3a12d19 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:59.488108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9cef1eb0-292e-4d21-8f86-68ffd3a12d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:10:59.587709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 705/1388] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:10:59.890188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe45a-d1e8-44d3-872e-c4703c9ff2c4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:59.890474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe45a-d1e8-44d3-872e-c4703c9ff2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:59.890750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe45a-d1e8-44d3-872e-c4703c9ff2c4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:59.892164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 684/1389] 10.222.0.27 () {54 vars in 962 bytes} [Sat Oct 1 04:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:10:59.897329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283c30-f23a-41c8-8d50-d241e7dc7ba0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:10:59.897614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283c30-f23a-41c8-8d50-d241e7dc7ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:10:59.897913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f283c30-f23a-41c8-8d50-d241e7dc7ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:10:59.913404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:59.974699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8f283c30-f23a-41c8-8d50-d241e7dc7ba0 None None] MFA Rules not processed for user `1afa3489655343c699a658472da4646b`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:10:59.975918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8f283c30-f23a-41c8-8d50-d241e7dc7ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:00.052571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 706/1390] 10.222.0.27 () {58 vars in 1059 bytes} [Sat Oct 1 04:10:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:00.062184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe45a-d1e8-44d3-872e-c4703c9ff2c4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:00.063773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-322fe45a-d1e8-44d3-872e-c4703c9ff2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:00.166808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe45a-d1e8-44d3-872e-c4703c9ff2c4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:00.227109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:00.243493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:00.244146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:00.244427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:00.244697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:00.246289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:00.357212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:00.358690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d994d2-1fc6-4305-aa34-0db920878206 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:00.376654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 685/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:01.118909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6be483-1b1b-4a5f-aa45-2f6f420a7beb None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.119376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6be483-1b1b-4a5f-aa45-2f6f420a7beb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.119654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6be483-1b1b-4a5f-aa45-2f6f420a7beb None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.126805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a7175-1a47-410e-935a-fd4583aea87f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.127528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a7175-1a47-410e-935a-fd4583aea87f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.127628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a7175-1a47-410e-935a-fd4583aea87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.128065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 707/1392] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:11:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:01.129609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b72d43-2238-4836-8b46-ed1b16ac030b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.129961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b72d43-2238-4836-8b46-ed1b16ac030b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.130304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b72d43-2238-4836-8b46-ed1b16ac030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.199694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0d2a7175-1a47-410e-935a-fd4583aea87f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:01.201280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0d2a7175-1a47-410e-935a-fd4583aea87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.203174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-74b72d43-2238-4836-8b46-ed1b16ac030b None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:01.204383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-74b72d43-2238-4836-8b46-ed1b16ac030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.249143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:01.263253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:01.300987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 708/1393] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:11:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:01.310366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 686/1394] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:11:01.345097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da730d3-f2f4-4bc6-b32e-e38923f41e38 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.345382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da730d3-f2f4-4bc6-b32e-e38923f41e38 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.345660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da730d3-f2f4-4bc6-b32e-e38923f41e38 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.346995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 709/1395] 10.222.0.27 () {54 vars in 943 bytes} [Sat Oct 1 04:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:01.353295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.353575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.353846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.434314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] MFA Rules not processed for user `afc96390262a4509ba740d0708ae26aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:01.435594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.541947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 687/1396] 10.222.0.27 () {58 vars in 1040 bytes} [Sat Oct 1 04:11:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:11:01.551819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da730d3-f2f4-4bc6-b32e-e38923f41e38 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:01.553384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0da730d3-f2f4-4bc6-b32e-e38923f41e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.602426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:01.603632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.607020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:01.691589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da730d3-f2f4-4bc6-b32e-e38923f41e38 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:01.703127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853d010-3d84-4b40-ad5d-f73e91efc5c5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:01.750617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:01.797974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:01.798666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.798946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.799219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.800893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.819320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:01.820149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:01.820426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:01.820694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:01.822325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:01.835139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:01.892487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:01.894097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531bfe-2965-4f8a-816c-52e2344b974b service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:01.902010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 710/1397] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:11:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:11:01.915500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:01.917068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1162db5-da17-4577-954f-08a53529dc11 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:01.937503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 688/1398] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:11:04.145892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577932b-6a39-478d-860f-7d1f2174a1ab None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:04.146482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577932b-6a39-478d-860f-7d1f2174a1ab None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:04.146482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577932b-6a39-478d-860f-7d1f2174a1ab None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:04.147782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 711/1399] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:04.153449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22842-84c2-479f-ae78-5f9b5dcfb816 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:04.153923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22842-84c2-479f-ae78-5f9b5dcfb816 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:04.154041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22842-84c2-479f-ae78-5f9b5dcfb816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:04.226793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-25b22842-84c2-479f-ae78-5f9b5dcfb816 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:04.228147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25b22842-84c2-479f-ae78-5f9b5dcfb816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:04.325101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:04.337738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 689/1400] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:04.634899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577932b-6a39-478d-860f-7d1f2174a1ab None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:04.637871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f577932b-6a39-478d-860f-7d1f2174a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:04.753824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:04.821787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577932b-6a39-478d-860f-7d1f2174a1ab None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:04.952336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:04.952974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:04.953336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:04.953663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:04.955336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:05.024249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:05.063520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:05.065158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd7eed-7f46-4fb9-adfe-2a9f2e0b59eb service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:05.086524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 712/1401] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:07.314819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a200-b9f5-4d19-9530-441310a88288 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:07.315354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a200-b9f5-4d19-9530-441310a88288 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:07.315354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a200-b9f5-4d19-9530-441310a88288 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:07.317031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 690/1402] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:07.322104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a170b8-dd8d-4191-96dd-fd59828f9fb7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:07.322525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a170b8-dd8d-4191-96dd-fd59828f9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:07.322684 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a170b8-dd8d-4191-96dd-fd59828f9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:07.519903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-51a170b8-dd8d-4191-96dd-fd59828f9fb7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:07.521324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-51a170b8-dd8d-4191-96dd-fd59828f9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:07.629425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 713/1403] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:07.920394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a200-b9f5-4d19-9530-441310a88288 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:07.921921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a05a200-b9f5-4d19-9530-441310a88288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:08.091413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a200-b9f5-4d19-9530-441310a88288 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:08.170317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:08.234242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:08.234882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:08.235176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:08.235482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:08.237215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:08.341181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:08.342858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edb807-3dd7-4e68-85d8-599ba984424c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:08.366237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 691/1404] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:10.674331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d385-d0a9-44fa-8230-c5be4a43cf43 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:10.674904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d385-d0a9-44fa-8230-c5be4a43cf43 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:10.674904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d385-d0a9-44fa-8230-c5be4a43cf43 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:10.680277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 714/1405] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:10.681858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b7a5-6745-4ea8-a0ff-4e47c3fbeb94 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:10.682308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b7a5-6745-4ea8-a0ff-4e47c3fbeb94 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:10.682411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b7a5-6745-4ea8-a0ff-4e47c3fbeb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:10.755928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f004b7a5-6745-4ea8-a0ff-4e47c3fbeb94 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:10.757579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f004b7a5-6745-4ea8-a0ff-4e47c3fbeb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:10.787455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:10.872729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 692/1406] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:11.162744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1d385-d0a9-44fa-8230-c5be4a43cf43 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:11.164310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6fd1d385-d0a9-44fa-8230-c5be4a43cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:11.204883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:11.331778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1d385-d0a9-44fa-8230-c5be4a43cf43 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:11.444558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:11.450803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:11.451423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:11.451708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:11.452011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:11.453633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:11.564975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:11.566708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fdc43-c350-441d-a11d-b377469a376b service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:11.586966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 715/1407] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:20.870790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=31 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:21.584557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=47 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:24.469145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884af7-da5e-491e-bcb7-84ce7c82ed58 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:24.469717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884af7-da5e-491e-bcb7-84ce7c82ed58 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:24.469717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884af7-da5e-491e-bcb7-84ce7c82ed58 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:24.471112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 693/1408] 10.222.0.27 () {54 vars in 918 bytes} [Sat Oct 1 04:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:24.476049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032012ae-f057-42b2-8842-cb962f2266b9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:24.476456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032012ae-f057-42b2-8842-cb962f2266b9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:24.476595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032012ae-f057-42b2-8842-cb962f2266b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:24.551274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-032012ae-f057-42b2-8842-cb962f2266b9 None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:24.552521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-032012ae-f057-42b2-8842-cb962f2266b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:24.658133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 716/1409] 10.222.0.27 () {58 vars in 1015 bytes} [Sat Oct 1 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:24.673040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c6d68-7f4d-47d6-9698-ca57ec719d5f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:24.673327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c6d68-7f4d-47d6-9698-ca57ec719d5f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:24.673605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c6d68-7f4d-47d6-9698-ca57ec719d5f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:24.674932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 694/1410] 10.222.0.27 () {54 vars in 918 bytes} [Sat Oct 1 04:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:24.679618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89dbf-9912-489e-9a15-579667e5f7c1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:24.679943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89dbf-9912-489e-9a15-579667e5f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:24.680240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89dbf-9912-489e-9a15-579667e5f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:24.751067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:24.753935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-48e89dbf-9912-489e-9a15-579667e5f7c1 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:24.755658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-48e89dbf-9912-489e-9a15-579667e5f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:24.871103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 717/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Sat Oct 1 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:27.406582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663783-f1ae-440d-bae7-658d4b3ff7cc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:27.407163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663783-f1ae-440d-bae7-658d4b3ff7cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:27.407163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663783-f1ae-440d-bae7-658d4b3ff7cc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:27.408471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 695/1412] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:27.413652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b59d2-0d57-4ced-b01f-2fc0e6c9d452 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:27.414057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b59d2-0d57-4ced-b01f-2fc0e6c9d452 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:27.414204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b59d2-0d57-4ced-b01f-2fc0e6c9d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:27.478948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-510b59d2-0d57-4ced-b01f-2fc0e6c9d452 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:27.480195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-510b59d2-0d57-4ced-b01f-2fc0e6c9d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:27.533920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:27.576984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 718/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:27.862911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54663783-f1ae-440d-bae7-658d4b3ff7cc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:27.864605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-54663783-f1ae-440d-bae7-658d4b3ff7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:28.012945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54663783-f1ae-440d-bae7-658d4b3ff7cc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:28.084849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:28.126031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:28.126640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:28.126917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:28.127190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:28.129098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:28.217386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:28.218979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e23e-eb5c-451d-9861-6e30b72a4845 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:28.236597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 696/1414] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:29.372564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27699260-720d-4cf3-8483-eece6c61789c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:29.373158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27699260-720d-4cf3-8483-eece6c61789c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:29.373158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27699260-720d-4cf3-8483-eece6c61789c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:29.374423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 719/1415] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:29.380811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221f2f-e631-47fd-aa2c-c2a6d73e23f9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:29.381248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221f2f-e631-47fd-aa2c-c2a6d73e23f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:29.381360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221f2f-e631-47fd-aa2c-c2a6d73e23f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:29.456088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-af221f2f-e631-47fd-aa2c-c2a6d73e23f9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:29.457283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-af221f2f-e631-47fd-aa2c-c2a6d73e23f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:29.483757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:29.552106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 697/1416] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:29.702881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27699260-720d-4cf3-8483-eece6c61789c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:29.704343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-27699260-720d-4cf3-8483-eece6c61789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:29.846943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27699260-720d-4cf3-8483-eece6c61789c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:29.886317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:29.959142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:29.959680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:29.959983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:29.960262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:29.961851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:30.050171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:30.051738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72305181-e623-43b9-90a6-bcbb41337b7a service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:30.068958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 720/1417] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:31.203056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ff292-0080-4ce7-9cb0-02f11341f628 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:31.203580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ff292-0080-4ce7-9cb0-02f11341f628 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:31.203580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ff292-0080-4ce7-9cb0-02f11341f628 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:31.204914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 698/1418] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:31.211109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d652a5-9177-4986-86ca-602c99759fce None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:31.211601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d652a5-9177-4986-86ca-602c99759fce None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:31.211705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d652a5-9177-4986-86ca-602c99759fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:31.265354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:31.287815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-68d652a5-9177-4986-86ca-602c99759fce None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:31.289086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-68d652a5-9177-4986-86ca-602c99759fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:31.387653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 721/1419] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:31.536826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ff292-0080-4ce7-9cb0-02f11341f628 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:31.538329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-260ff292-0080-4ce7-9cb0-02f11341f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:31.680593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ff292-0080-4ce7-9cb0-02f11341f628 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:31.692461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:31.791046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:31.791567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:31.791839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:31.792129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:31.794251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:31.881345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:31.882933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a507b-e910-43c2-b9e0-941e3ff75e2c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:31.900988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 699/1420] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:33.004858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799aa90-b2a3-4d4d-a116-29fa43d70d3a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:33.005429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799aa90-b2a3-4d4d-a116-29fa43d70d3a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:33.005429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799aa90-b2a3-4d4d-a116-29fa43d70d3a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:33.006733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 722/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:33.013687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e5ef-35ee-4df1-b1f0-0ac1f47dc1d1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:33.014125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e5ef-35ee-4df1-b1f0-0ac1f47dc1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:33.014229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e5ef-35ee-4df1-b1f0-0ac1f47dc1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:33.034191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:33.090257 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2d82e5ef-35ee-4df1-b1f0-0ac1f47dc1d1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:33.091450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2d82e5ef-35ee-4df1-b1f0-0ac1f47dc1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:33.185692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 700/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:33.336332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799aa90-b2a3-4d4d-a116-29fa43d70d3a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:33.337766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6799aa90-b2a3-4d4d-a116-29fa43d70d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:33.447276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:33.482777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799aa90-b2a3-4d4d-a116-29fa43d70d3a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:33.592906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:33.593444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:33.593721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:33.594035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:33.595627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:33.676833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:33.690889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:33.693732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd05e6-a3fc-49fc-a582-08da57e854f2 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:33.711757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 723/1423] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:34.823560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751bb58-bd06-426a-aad4-1e45a51db0de None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:34.824133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751bb58-bd06-426a-aad4-1e45a51db0de None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:34.824242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751bb58-bd06-426a-aad4-1e45a51db0de None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:34.826001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 701/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:34.832490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8c7f-f16a-45db-9f1f-01b31a9de0ea None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:34.832907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8c7f-f16a-45db-9f1f-01b31a9de0ea None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:34.833014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c8c7f-f16a-45db-9f1f-01b31a9de0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:34.907382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0b3c8c7f-f16a-45db-9f1f-01b31a9de0ea None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:34.908621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0b3c8c7f-f16a-45db-9f1f-01b31a9de0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:35.002184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 724/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:35.151979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751bb58-bd06-426a-aad4-1e45a51db0de None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:35.153979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5751bb58-bd06-426a-aad4-1e45a51db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:35.238806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:35.301966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751bb58-bd06-426a-aad4-1e45a51db0de None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:35.413019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:35.413549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:35.413828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:35.414098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:35.415697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:35.463351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:35.504895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:35.506514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474996c-4c6d-4798-81b9-95902d587e13 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:35.524651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 702/1426] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:36.572135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03d65-5f5e-4bf3-9890-234b5b844ee4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:36.572696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03d65-5f5e-4bf3-9890-234b5b844ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:36.572696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f03d65-5f5e-4bf3-9890-234b5b844ee4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:36.573995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 725/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:36.580857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc19c-9989-46ac-84e1-032f31a20610 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:36.581298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc19c-9989-46ac-84e1-032f31a20610 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:36.581408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc19c-9989-46ac-84e1-032f31a20610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:36.656285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0c3bc19c-9989-46ac-84e1-032f31a20610 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:36.657410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c3bc19c-9989-46ac-84e1-032f31a20610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:36.752198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 703/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:36.902594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03d65-5f5e-4bf3-9890-234b5b844ee4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:36.904221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-11f03d65-5f5e-4bf3-9890-234b5b844ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:36.952029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:37.045956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f03d65-5f5e-4bf3-9890-234b5b844ee4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:37.154833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:37.155433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:37.155709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:37.156023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:37.157622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:37.164458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:37.247288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:37.248907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728b5cb-824f-41fd-a51a-a1665dea25cf service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:37.266641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 726/1429] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:38.314291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5dd01-87c7-4187-957b-76e30c472750 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:38.314879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5dd01-87c7-4187-957b-76e30c472750 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:38.314879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5dd01-87c7-4187-957b-76e30c472750 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:38.316206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 704/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:38.322422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783103cc-59e1-4a88-87f0-9a7271f80e7c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:38.322848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783103cc-59e1-4a88-87f0-9a7271f80e7c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:38.322951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783103cc-59e1-4a88-87f0-9a7271f80e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:38.397466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-783103cc-59e1-4a88-87f0-9a7271f80e7c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:38.398668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-783103cc-59e1-4a88-87f0-9a7271f80e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:38.464140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:38.493081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 727/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:38.645165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5dd01-87c7-4187-957b-76e30c472750 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:38.646679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35c5dd01-87c7-4187-957b-76e30c472750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:38.664802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:38.797013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5dd01-87c7-4187-957b-76e30c472750 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:38.884632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:38.914301 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:38.914834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:38.915111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:38.915381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:38.917107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:39.007308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:39.008953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ad517-5830-421a-badb-c7c01ffcf811 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:39.026761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 705/1432] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:40.090596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bcee-0754-4f70-89a8-afcbba4e39d3 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:40.091789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bcee-0754-4f70-89a8-afcbba4e39d3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:40.091789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bcee-0754-4f70-89a8-afcbba4e39d3 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:40.093048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 728/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:40.099247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e094-2462-4034-95aa-f16a64e38c5b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:40.099709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e094-2462-4034-95aa-f16a64e38c5b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:40.099826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247e094-2462-4034-95aa-f16a64e38c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:40.174779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6247e094-2462-4034-95aa-f16a64e38c5b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:40.175994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6247e094-2462-4034-95aa-f16a64e38c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:40.217575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:40.271668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 706/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:40.421689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768bcee-0754-4f70-89a8-afcbba4e39d3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:40.423125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9768bcee-0754-4f70-89a8-afcbba4e39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:40.565273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768bcee-0754-4f70-89a8-afcbba4e39d3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:40.618512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:40.676921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:40.677522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:40.677794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:40.678060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:40.679721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:40.772596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:40.774180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb70958-263a-42f7-be3a-379f44dbe801 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:40.792270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 729/1435] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:41.834763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8546-d5c3-4320-a2f1-eb194be476f9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:41.835219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8546-d5c3-4320-a2f1-eb194be476f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:41.835328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e8546-d5c3-4320-a2f1-eb194be476f9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:41.836699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 707/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:41.842922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876613-2c8c-4d05-a8d0-c5507978be73 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:41.843352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876613-2c8c-4d05-a8d0-c5507978be73 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:41.843466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876613-2c8c-4d05-a8d0-c5507978be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:41.916667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-20876613-2c8c-4d05-a8d0-c5507978be73 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:41.917860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-20876613-2c8c-4d05-a8d0-c5507978be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:41.920142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:42.011718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 730/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:42.160187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8546-d5c3-4320-a2f1-eb194be476f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:42.161664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-356e8546-d5c3-4320-a2f1-eb194be476f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:42.304996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e8546-d5c3-4320-a2f1-eb194be476f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:42.331537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:42.418374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:42.418895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:42.419674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:42.419998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:42.421600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:42.509271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:42.510865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0e9f0-d8ef-4ad5-a5c7-735658f6f20d service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:42.529177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 708/1438] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:44.562220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9b897-ac25-4744-bd20-9ec4d7d26503 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:44.562777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9b897-ac25-4744-bd20-9ec4d7d26503 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:44.562777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9b897-ac25-4744-bd20-9ec4d7d26503 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:44.564115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 731/1439] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:44.569317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377d5c-2ca3-4dfb-8ea2-d200cda120f8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:44.569732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377d5c-2ca3-4dfb-8ea2-d200cda120f8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:44.569885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377d5c-2ca3-4dfb-8ea2-d200cda120f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:44.610884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:44.635750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a377d5c-2ca3-4dfb-8ea2-d200cda120f8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:44.636969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a377d5c-2ca3-4dfb-8ea2-d200cda120f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:44.731465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 709/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:45.030051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccd03-8a21-4622-bc6b-49efefd5516a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:45.030335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccd03-8a21-4622-bc6b-49efefd5516a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:45.030608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ccd03-8a21-4622-bc6b-49efefd5516a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:45.031959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 732/1441] 10.222.0.27 () {54 vars in 964 bytes} [Sat Oct 1 04:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:45.037690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2c5e-ff6a-4a43-a843-7a98638dfd82 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:45.037978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2c5e-ff6a-4a43-a843-7a98638dfd82 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:45.038249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2c5e-ff6a-4a43-a843-7a98638dfd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:45.115347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5b7b2c5e-ff6a-4a43-a843-7a98638dfd82 None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:45.116517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5b7b2c5e-ff6a-4a43-a843-7a98638dfd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:45.167874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:45.193376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 710/1442] 10.222.0.27 () {58 vars in 1061 bytes} [Sat Oct 1 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:45.202301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ccd03-8a21-4622-bc6b-49efefd5516a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:45.203830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f50ccd03-8a21-4622-bc6b-49efefd5516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:45.313201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ccd03-8a21-4622-bc6b-49efefd5516a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:45.344906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:45.388928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:45.389458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:45.389735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:45.390001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:45.391587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:45.500942 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:45.502363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e86667-54d5-47c2-adba-684c970d662f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:45.520691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 733/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:48.185385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba05fb-b282-4991-98d2-37f4b9fa3603 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:48.185917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba05fb-b282-4991-98d2-37f4b9fa3603 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:48.185917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba05fb-b282-4991-98d2-37f4b9fa3603 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:48.187169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:48.192332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118daef4-157c-43f5-8f96-66800683ec23 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:48.192725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118daef4-157c-43f5-8f96-66800683ec23 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:48.192884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118daef4-157c-43f5-8f96-66800683ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:48.258045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-118daef4-157c-43f5-8f96-66800683ec23 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:48.259240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-118daef4-157c-43f5-8f96-66800683ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:48.272087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:48.355097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:48.635238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba05fb-b282-4991-98d2-37f4b9fa3603 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:48.636880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-69ba05fb-b282-4991-98d2-37f4b9fa3603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:48.739281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba05fb-b282-4991-98d2-37f4b9fa3603 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:48.815244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:48.816172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:48.816452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:48.816722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:48.818320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:48.849202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:48.927964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:48.929334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c041ea-9db7-4a98-91f6-5b1311813644 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:48.947714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 712/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:51.468032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f3ad-c85a-4444-b7e1-0e788bfd2234 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:51.468605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f3ad-c85a-4444-b7e1-0e788bfd2234 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:51.468605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514f3ad-c85a-4444-b7e1-0e788bfd2234 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:51.469951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:51.475172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5db11-fabf-4677-9a2b-6d4312384315 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:51.475580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5db11-fabf-4677-9a2b-6d4312384315 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:51.475730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5db11-fabf-4677-9a2b-6d4312384315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:51.543239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-70c5db11-fabf-4677-9a2b-6d4312384315 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:51.544619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70c5db11-fabf-4677-9a2b-6d4312384315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:51.621477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:51.641261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:51.940041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f3ad-c85a-4444-b7e1-0e788bfd2234 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:51.941619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c514f3ad-c85a-4444-b7e1-0e788bfd2234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:52.042479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514f3ad-c85a-4444-b7e1-0e788bfd2234 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:52.082143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:52.115806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:52.116438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:52.116719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:52.116991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:52.118604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:52.226267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:52.227692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da4a4c-342e-472d-806a-789261398957 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:52.245722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 736/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:54.509681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cace29-6b58-48c2-be6e-c35f83687378 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:54.510261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cace29-6b58-48c2-be6e-c35f83687378 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:54.510261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cace29-6b58-48c2-be6e-c35f83687378 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:54.511579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:54.516950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c86d8-1a3e-4b32-a44f-3b984c2f4908 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:54.517361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c86d8-1a3e-4b32-a44f-3b984c2f4908 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:54.517504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c86d8-1a3e-4b32-a44f-3b984c2f4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:54.584149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-253c86d8-1a3e-4b32-a44f-3b984c2f4908 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:54.585358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-253c86d8-1a3e-4b32-a44f-3b984c2f4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:54.605991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:54.681379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:54.963314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cace29-6b58-48c2-be6e-c35f83687378 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:54.964933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-75cace29-6b58-48c2-be6e-c35f83687378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:55.074206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cace29-6b58-48c2-be6e-c35f83687378 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:55.152239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:55.152847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:55.153123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:55.153393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:55.154999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:55.195030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:55.265322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:55.266753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210da43-156d-49c5-8485-2b244f8daf66 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:55.285394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 715/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:57.478878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068c55e-c7b4-48ff-9ebc-1d8d692dbeb5 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:57.479415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068c55e-c7b4-48ff-9ebc-1d8d692dbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:57.479578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068c55e-c7b4-48ff-9ebc-1d8d692dbeb5 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:57.481000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:11:57.487150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffb1e1-3eb0-4d81-913a-a25f570c8084 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:57.487564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffb1e1-3eb0-4d81-913a-a25f570c8084 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:57.487693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffb1e1-3eb0-4d81-913a-a25f570c8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:57.554417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3bffb1e1-3eb0-4d81-913a-a25f570c8084 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:11:57.555615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3bffb1e1-3eb0-4d81-913a-a25f570c8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:57.643735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:57.649959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:11:57.939338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068c55e-c7b4-48ff-9ebc-1d8d692dbeb5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:11:57.940898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1068c55e-c7b4-48ff-9ebc-1d8d692dbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:58.041872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068c55e-c7b4-48ff-9ebc-1d8d692dbeb5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:11:58.089458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:58.113531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:11:58.114127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:11:58.114417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:11:58.114669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:11:58.116264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:11:58.222798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:11:58.224249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdd594-4175-452e-8171-1343861d1753 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:11:58.242032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 739/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:00.490552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d233-ef8a-4fa7-97f1-4120ad7fadd9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:00.491122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d233-ef8a-4fa7-97f1-4120ad7fadd9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:00.491122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d233-ef8a-4fa7-97f1-4120ad7fadd9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:00.492490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:00.498378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3b12e-2575-46c6-bd6e-66b57092581b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:00.498773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3b12e-2575-46c6-bd6e-66b57092581b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:00.498922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3b12e-2575-46c6-bd6e-66b57092581b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:00.565224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-85e3b12e-2575-46c6-bd6e-66b57092581b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:00.566431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-85e3b12e-2575-46c6-bd6e-66b57092581b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:00.595248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:00.661100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:00.945925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d233-ef8a-4fa7-97f1-4120ad7fadd9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:00.947449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7988d233-ef8a-4fa7-97f1-4120ad7fadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:01.054071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d233-ef8a-4fa7-97f1-4120ad7fadd9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:01.126510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:01.127116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:01.127395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:01.127672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:01.129306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:01.177104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:01.237433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:01.238855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457af85-8982-45f0-902b-c08588ac11c9 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:01.256912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 718/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:12:03.462950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ebedc-7e1f-421d-9117-7f3ab86e10a6 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:03.463532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ebedc-7e1f-421d-9117-7f3ab86e10a6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:03.463532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ebedc-7e1f-421d-9117-7f3ab86e10a6 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:03.464858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:03.470712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9f8d-1b15-4048-8133-6c8d853b3ff8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:03.471151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9f8d-1b15-4048-8133-6c8d853b3ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:03.471256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9f8d-1b15-4048-8133-6c8d853b3ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:03.536855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-487e9f8d-1b15-4048-8133-6c8d853b3ff8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:03.538040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-487e9f8d-1b15-4048-8133-6c8d853b3ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:03.632341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:03.924513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ebedc-7e1f-421d-9117-7f3ab86e10a6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:03.926038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ed3ebedc-7e1f-421d-9117-7f3ab86e10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:04.028714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ebedc-7e1f-421d-9117-7f3ab86e10a6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:04.084097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:04.102569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:04.103168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:04.103443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:04.103711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:04.105310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:04.221481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:04.222890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57da26f-b7f9-4724-9aa1-3db32b79c367 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:04.240690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 742/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:06.449545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decaba4-a5f8-4a10-9149-b37bc3ab4db9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:06.450163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decaba4-a5f8-4a10-9149-b37bc3ab4db9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:06.450163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decaba4-a5f8-4a10-9149-b37bc3ab4db9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:06.451528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:06.457300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18688-1f33-4f66-9be4-599faadb98ee None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:06.457800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18688-1f33-4f66-9be4-599faadb98ee None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:06.457907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18688-1f33-4f66-9be4-599faadb98ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:06.526696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-03f18688-1f33-4f66-9be4-599faadb98ee None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:06.527904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-03f18688-1f33-4f66-9be4-599faadb98ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:06.568116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:06.628129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:06.924076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decaba4-a5f8-4a10-9149-b37bc3ab4db9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:06.925628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1decaba4-a5f8-4a10-9149-b37bc3ab4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:06.929521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:07.028966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decaba4-a5f8-4a10-9149-b37bc3ab4db9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:07.102377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:07.102986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:07.103267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:07.103541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:07.105178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:07.164072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:07.214674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:07.216076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d5fb5-bded-4d40-a716-0f748ce0d6a6 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:07.233781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 721/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:09.381531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321dbf1-570c-45cd-a447-f433237d06f8 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:09.382053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321dbf1-570c-45cd-a447-f433237d06f8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:09.382053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321dbf1-570c-45cd-a447-f433237d06f8 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:09.383322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:09.389207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6104a-d665-4d9c-9727-e379bc4219d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:09.389638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6104a-d665-4d9c-9727-e379bc4219d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:09.389746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6104a-d665-4d9c-9727-e379bc4219d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:09.455428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4d6104a-d665-4d9c-9727-e379bc4219d0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:09.456659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4d6104a-d665-4d9c-9727-e379bc4219d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:09.554942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:09.838293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321dbf1-570c-45cd-a447-f433237d06f8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:09.839857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5321dbf1-570c-45cd-a447-f433237d06f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:09.940841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321dbf1-570c-45cd-a447-f433237d06f8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:10.005596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:10.013050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:10.014151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:10.014424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:10.014687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:10.016280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:10.122767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:10.124149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607b98b-3071-4a7d-aea6-b26947fb49aa service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:10.142965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 745/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:12.279068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14788884-756a-496a-b51d-f7f533167f5e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:12.279680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14788884-756a-496a-b51d-f7f533167f5e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:12.279680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14788884-756a-496a-b51d-f7f533167f5e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:12.281062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:12.286388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da4c9-e6bc-429f-b59a-f655e8b58a07 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:12.286800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da4c9-e6bc-429f-b59a-f655e8b58a07 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:12.286930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da4c9-e6bc-429f-b59a-f655e8b58a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:12.351717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-790da4c9-e6bc-429f-b59a-f655e8b58a07 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:12.352959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-790da4c9-e6bc-429f-b59a-f655e8b58a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:12.400895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:12.448618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:12.733327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14788884-756a-496a-b51d-f7f533167f5e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:12.734870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-14788884-756a-496a-b51d-f7f533167f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:12.748377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:12.838777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14788884-756a-496a-b51d-f7f533167f5e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:12.913199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:12.913805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:12.914079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:12.914347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:12.915967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:12.982651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:13.023634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:13.025080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c1398-8223-4ece-a574-c39b2069b6e7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:13.043020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 724/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:22.447103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=22 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:23.040825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=25 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:32.819916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e138df-da6e-40e1-9a03-a1ce8b5e7f3a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:32.820397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e138df-da6e-40e1-9a03-a1ce8b5e7f3a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:32.820534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e138df-da6e-40e1-9a03-a1ce8b5e7f3a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:32.821881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 747/1471] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:32.827763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a6e2-00a3-4388-9a13-b65a33f2f43d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:32.828242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a6e2-00a3-4388-9a13-b65a33f2f43d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:32.828346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a6e2-00a3-4388-9a13-b65a33f2f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:32.893809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a565a6e2-00a3-4388-9a13-b65a33f2f43d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:32.894998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a565a6e2-00a3-4388-9a13-b65a33f2f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:32.989382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 725/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:12:33.284679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c25da2-c378-4796-ae53-c8f383762fcb None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:33.284965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c25da2-c378-4796-ae53-c8f383762fcb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:33.285240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c25da2-c378-4796-ae53-c8f383762fcb None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:33.286582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 748/1473] 10.222.0.27 () {54 vars in 962 bytes} [Sat Oct 1 04:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:33.291437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfccc-79ee-4997-805e-80f52cb2ae79 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:33.291721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfccc-79ee-4997-805e-80f52cb2ae79 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:33.292018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfccc-79ee-4997-805e-80f52cb2ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:33.481157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4acfccc-79ee-4997-805e-80f52cb2ae79 None None] MFA Rules not processed for user `1afa3489655343c699a658472da4646b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:33.482373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4acfccc-79ee-4997-805e-80f52cb2ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:33.503127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:33.558392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 726/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Sat Oct 1 04:12:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:33.566070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c25da2-c378-4796-ae53-c8f383762fcb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:33.567606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c8c25da2-c378-4796-ae53-c8f383762fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:33.668219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c25da2-c378-4796-ae53-c8f383762fcb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:33.741814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:33.742410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:33.742685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:33.742951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:33.744552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:33.797562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:33.854979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:33.856446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27ef1-aff4-4c11-aab0-6beda098b21c service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:33.874204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 749/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:36.102254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf99cb-5a4a-4ee0-93d6-636af3590aa7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:36.102810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf99cb-5a4a-4ee0-93d6-636af3590aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:36.102810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf99cb-5a4a-4ee0-93d6-636af3590aa7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:36.104062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 727/1476] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:36.109687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0bf35-1ccb-40ca-91ec-24f022b7be39 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:36.110119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0bf35-1ccb-40ca-91ec-24f022b7be39 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:36.110227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0bf35-1ccb-40ca-91ec-24f022b7be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:36.174642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-25b0bf35-1ccb-40ca-91ec-24f022b7be39 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:36.175826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-25b0bf35-1ccb-40ca-91ec-24f022b7be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:36.269026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 750/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:36.540906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf99cb-5a4a-4ee0-93d6-636af3590aa7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:36.542423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d1cf99cb-5a4a-4ee0-93d6-636af3590aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:36.666770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf99cb-5a4a-4ee0-93d6-636af3590aa7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:36.715031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:36.758116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:36.758721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:36.759000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:36.759274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:36.759901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:36.761647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:12:36.761647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:12:36.761647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:12:36.762774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d15f5-7213-4cd3-9406-b6176b0d1ac9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:36.782382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 728/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Sat Oct 1 04:12:36 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:12:38.956311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dbd56-d783-4333-902a-d0174cf9e0e0 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:38.956862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dbd56-d783-4333-902a-d0174cf9e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:38.956862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932dbd56-d783-4333-902a-d0174cf9e0e0 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:38.958175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 751/1479] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:38.963456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb24f2-9cc2-40e8-a888-bcc25cf58e2e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:38.963883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb24f2-9cc2-40e8-a888-bcc25cf58e2e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:38.964045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb24f2-9cc2-40e8-a888-bcc25cf58e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:39.032511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-96fb24f2-9cc2-40e8-a888-bcc25cf58e2e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:39.033722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-96fb24f2-9cc2-40e8-a888-bcc25cf58e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:39.130397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 729/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:39.424037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dbd56-d783-4333-902a-d0174cf9e0e0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:39.425546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-932dbd56-d783-4333-902a-d0174cf9e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:39.435252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:39.570547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932dbd56-d783-4333-902a-d0174cf9e0e0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:39.650258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:39.684222 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:39.684827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:39.685106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:39.685379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:39.686974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:39.775883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:39.777487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febb749-a6b4-441a-bb6a-0d19f25fe99f service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:39.795864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 752/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:42.116655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdcef4-4c40-45d5-bf12-6cafa7aa564c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:42.117161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdcef4-4c40-45d5-bf12-6cafa7aa564c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:42.117161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdcef4-4c40-45d5-bf12-6cafa7aa564c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:42.118445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 730/1482] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:42.124355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d48d-9f73-4cf4-b5e7-ca2778e4c0f3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:42.124776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d48d-9f73-4cf4-b5e7-ca2778e4c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:42.124915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5d48d-9f73-4cf4-b5e7-ca2778e4c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:42.189925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-20c5d48d-9f73-4cf4-b5e7-ca2778e4c0f3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:42.191130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-20c5d48d-9f73-4cf4-b5e7-ca2778e4c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:42.236478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:42.285714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 753/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:42.570221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdcef4-4c40-45d5-bf12-6cafa7aa564c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:42.571784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dacdcef4-4c40-45d5-bf12-6cafa7aa564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:42.595565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:42.674122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdcef4-4c40-45d5-bf12-6cafa7aa564c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:42.745275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:42.745881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:42.746156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:42.746420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:42.748033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:42.822199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:42.856938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:42.858876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f97942-8a61-4115-8de5-5d5b12afbf1e service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:42.877637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 731/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:45.086229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca149a8-7660-427a-8104-3fcbf7000799 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:45.086750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca149a8-7660-427a-8104-3fcbf7000799 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:45.086750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca149a8-7660-427a-8104-3fcbf7000799 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:45.088206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 754/1485] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:45.093429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cafb8-1823-4562-a701-a176cb7fe94f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:45.093824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cafb8-1823-4562-a701-a176cb7fe94f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:45.093979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cafb8-1823-4562-a701-a176cb7fe94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:45.160255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-369cafb8-1823-4562-a701-a176cb7fe94f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:45.161479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-369cafb8-1823-4562-a701-a176cb7fe94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:45.259121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 732/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:45.553875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca149a8-7660-427a-8104-3fcbf7000799 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:45.555431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bca149a8-7660-427a-8104-3fcbf7000799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:45.655686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca149a8-7660-427a-8104-3fcbf7000799 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:45.728128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:45.729790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:45.730500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:45.730790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:45.731259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:45.733956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:45.843430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:45.844802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ab089-337d-4ad3-b4ab-429e976202fc service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:45.862900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 755/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:48.172182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c41aa-90d1-4334-b90c-f06df6950a46 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:48.172721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c41aa-90d1-4334-b90c-f06df6950a46 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:48.172721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c41aa-90d1-4334-b90c-f06df6950a46 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:48.174033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 733/1488] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:48.179414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af574c3b-f5c3-4cb8-8c99-4b22933cbff0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:48.179816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af574c3b-f5c3-4cb8-8c99-4b22933cbff0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:48.180015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af574c3b-f5c3-4cb8-8c99-4b22933cbff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:48.244206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-af574c3b-f5c3-4cb8-8c99-4b22933cbff0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:48.245396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-af574c3b-f5c3-4cb8-8c99-4b22933cbff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:48.298735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:48.347332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 756/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:48.640829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c41aa-90d1-4334-b90c-f06df6950a46 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:48.642408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-865c41aa-90d1-4334-b90c-f06df6950a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:48.678134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:48.744953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c41aa-90d1-4334-b90c-f06df6950a46 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:48.817942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:48.818551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:48.818826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:48.819095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:48.820725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:48.899105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:48.928105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:48.929530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947631d-5f55-4b1f-938a-885237df5c05 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:48.947595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 734/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:12:51.277874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56311-be9b-4471-83d7-c519b65e5a53 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:51.278420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56311-be9b-4471-83d7-c519b65e5a53 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:51.278420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56311-be9b-4471-83d7-c519b65e5a53 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:51.279829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 757/1491] 10.222.0.27 () {54 vars in 927 bytes} [Sat Oct 1 04:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:12:51.285293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6ea5e-a7e3-4738-a3b9-71db63714d84 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:51.285687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6ea5e-a7e3-4738-a3b9-71db63714d84 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:51.285846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6ea5e-a7e3-4738-a3b9-71db63714d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:51.352389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fec6ea5e-a7e3-4738-a3b9-71db63714d84 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:12:51.353590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fec6ea5e-a7e3-4738-a3b9-71db63714d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:51.449245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 735/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Sat Oct 1 04:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:12:51.735152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56311-be9b-4471-83d7-c519b65e5a53 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:12:51.736749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0cf56311-be9b-4471-83d7-c519b65e5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:51.840130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56311-be9b-4471-83d7-c519b65e5a53 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:12:51.913384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:12:51.913986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:12:51.914258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:12:51.914526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:12:51.916132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:12:51.924324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:52.022231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:12:52.023660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4ec6e-e045-4ad3-81c1-b7469fb18aee service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:12:52.041370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 758/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:13:01.447635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=82 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:13:02.038930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=50 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:09.815489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:09.816106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:09.816106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:09.892216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:14:09.894672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:09.987757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 736/1494] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:14:09.996205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:09.996691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:09.996787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:10.071111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:14:10.072268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:10.165873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 759/1495] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:14:10.170551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:10.171768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:10.182963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a227d-566d-4d78-804e-9ff3cdba95dd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:10.243129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:10.277312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:10.277915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:10.278184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:10.278447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:10.279073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:14:10.279370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:10.280395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:10.280395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:14:10.280395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:14:10.281274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:10.291998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 737/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:14:10.300254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:10.309198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f7d49-a825-47f2-8991-64b64c9a8fd7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:10.369414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:10.402909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:10.403506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:10.403782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:10.404080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:10.404737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:10.406452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:10.406452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:14:10.406452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:14:10.407649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:10.462223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 760/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:14:10 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:14:10.466509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:10.468102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:10.503038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076ac8-45b6-4754-a137-f6a3d1edcb5e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:10.602642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:10.603246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:10.603524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:10.603789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:10.604448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:10.605453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:10.605453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:14:10.605453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:14:10.606652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:10.659043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 738/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:14:10 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:14:10.663392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:10.665000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:10.726305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac728d0b-dea0-4862-891d-779bf7c3e393 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:10.808325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:10.820054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:10.820657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:10.820931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:10.821194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:10.821827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:10.822822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:10.822822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:14:10.822822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:14:10.823771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:10.836557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 761/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:14:10.840736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:10.842896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:10.854057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bed04-5c74-4cca-8b65-5252b129039f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:10.879614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:10.953840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:10.954635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:10.955077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:10.955471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:10.956184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:10.957204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:10.957204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:14:10.957204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:14:10.958092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cbf5d-c274-4681-822d-e2f62bdeb204 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:10.970958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 739/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:14:10.975224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:10.976775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:11.011354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a087022-369b-4968-933c-ab610b38c962 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:11.106329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:11.106983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:11.107262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:11.107530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] PATH_INFO: `/v3/projects/04ba60add9374a448d42ec73d46e3a76/users/cdcc9f62553d4d5c83341ba743ed6dd7/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:11.129946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ba60add9374a448d42ec73d46e3a76, user_id=cdcc9f62553d4d5c83341ba743ed6dd7, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:11.130967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:11.130967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:14:11.130967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:14:11.132968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ac62-2526-4448-8bed-291219989880 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:11.156845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 762/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:14:10 2022] PUT /identity/v3/projects/04ba60add9374a448d42ec73d46e3a76/users/cdcc9f62553d4d5c83341ba743ed6dd7/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:14:11.169214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1a900-258d-415e-9011-025b9d463730 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:11.169499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1a900-258d-415e-9011-025b9d463730 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:11.169772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1a900-258d-415e-9011-025b9d463730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:11.226433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8cc1a900-258d-415e-9011-025b9d463730 None None] MFA Rules not processed for user `cdcc9f62553d4d5c83341ba743ed6dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:14:11.227545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8cc1a900-258d-415e-9011-025b9d463730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:11.306985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 740/1502] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:14:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:14:11.320103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca345a6-8644-44e5-9692-9191c399d42b None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:11.320387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca345a6-8644-44e5-9692-9191c399d42b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:11.320664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca345a6-8644-44e5-9692-9191c399d42b None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:11.321979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 763/1503] 10.222.0.27 () {54 vars in 963 bytes} [Sat Oct 1 04:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:14:11.327346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db1156-52c8-4bd1-84e6-00687e5341a5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:11.327628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db1156-52c8-4bd1-84e6-00687e5341a5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:11.327899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db1156-52c8-4bd1-84e6-00687e5341a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:11.358982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:11.402944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-68db1156-52c8-4bd1-84e6-00687e5341a5 None None] MFA Rules not processed for user `d1c891f90f1b4b508752dfebc1de3589`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:14:11.404176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-68db1156-52c8-4bd1-84e6-00687e5341a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:11.478331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 741/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Sat Oct 1 04:14:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:14:11.487927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca345a6-8644-44e5-9692-9191c399d42b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:11.489484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fca345a6-8644-44e5-9692-9191c399d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:11.538627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:11.591803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca345a6-8644-44e5-9692-9191c399d42b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:11.663988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:11.664586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:11.664857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:11.665124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:11.666695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:11.761892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:11.763230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:11.767751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:11.782468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 764/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:14:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:14:11.827643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16613274-d4b2-4f36-84d5-1c9d348e7fa4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:11.827925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16613274-d4b2-4f36-84d5-1c9d348e7fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:11.828222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16613274-d4b2-4f36-84d5-1c9d348e7fa4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:11.829471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 742/1506] 10.222.0.27 () {52 vars in 830 bytes} [Sat Oct 1 04:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:14:11.833159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:11.834393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:11.932711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106c46-99eb-4ea5-99f0-134c6d06d650 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:12.024310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:12.024915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:12.025116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:12.025373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] PATH_INFO: `/v3/users/cdcc9f62553d4d5c83341ba743ed6dd7` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:12.037784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcc9f62553d4d5c83341ba743ed6dd7)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:12.038824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:12.038824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:14:12.038824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:14:12.040051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:12.050135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:12.105413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcc9f62553d4d5c83341ba743ed6dd7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:12.105954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcc9f62553d4d5c83341ba743ed6dd7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:12.119737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcc9f62553d4d5c83341ba743ed6dd7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:12.120218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcc9f62553d4d5c83341ba743ed6dd7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:12.130233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcc9f62553d4d5c83341ba743ed6dd7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:12.157937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 765/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:14:11 2022] DELETE /identity/v3/users/cdcc9f62553d4d5c83341ba743ed6dd7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:14:12.162440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:12.162887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:12.162995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:12.219954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:14:12.221164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:12.296180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:12.308826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 743/1508] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:14:12.318928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:12.320174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:12.423055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caebb-d1c8-4ab7-b467-e3e95f5ec920 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:12.479370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:12.500586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:12.501198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:12.501473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:12.501744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:12.503322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:12.622683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:12.624954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47b587-c718-4693-885f-69ac9fd8b5c3 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:12.644144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 766/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:14:12.986526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:14:12.987758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:14:13.000983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce737a61-8549-4bb6-8990-966e26292b88 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:14:13.095123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:14:13.095760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:14:13.096073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:14:13.096345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] PATH_INFO: `/v3/projects/04ba60add9374a448d42ec73d46e3a76` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:14:13.106068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ba60add9374a448d42ec73d46e3a76)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:14:13.107096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:14:13.107096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:14:13.107096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:14:13.108838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:14:13.165732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ba60add9374a448d42ec73d46e3a76', 'request_id': 'req-ff2f487d-f503-4e18-8041-124c826addd2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:13.179248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ba60add9374a448d42ec73d46e3a76', 'request_id': 'req-ff2f487d-f503-4e18-8041-124c826addd2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:13.190217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ba60add9374a448d42ec73d46e3a76', 'request_id': 'req-ff2f487d-f503-4e18-8041-124c826addd2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:13.212114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] The token cache is being invalidate because project 04ba60add9374a448d42ec73d46e3a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:14:13.212404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:13.212914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ff2f487d-f503-4e18-8041-124c826addd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:14:13.214214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 744/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:14:12 2022] DELETE /identity/v3/projects/04ba60add9374a448d42ec73d46e3a76 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:14:22.641806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=62 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:14:23.210170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:15:46.539734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0e15-1c8a-4af0-b7fe-8a62f2498849 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:46.540369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0e15-1c8a-4af0-b7fe-8a62f2498849 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:46.540369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0e15-1c8a-4af0-b7fe-8a62f2498849 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:46.541645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 767/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:15:46.547112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d426-934e-41ad-9b63-a120961b7844 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:46.547514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d426-934e-41ad-9b63-a120961b7844 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:46.547672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76d426-934e-41ad-9b63-a120961b7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:46.627387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0e76d426-934e-41ad-9b63-a120961b7844 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:15:46.628604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0e76d426-934e-41ad-9b63-a120961b7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:15:46.728531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 745/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:15:46.887862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a0e15-1c8a-4af0-b7fe-8a62f2498849 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:15:46.890487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-368a0e15-1c8a-4af0-b7fe-8a62f2498849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:15:47.006743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a0e15-1c8a-4af0-b7fe-8a62f2498849 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:15:47.012484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca6379-09f7-48f5-87c8-b38b7c1e66a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:15:47.013089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6379-09f7-48f5-87c8-b38b7c1e66a1 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:47.013368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6379-09f7-48f5-87c8-b38b7c1e66a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:47.013645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6379-09f7-48f5-87c8-b38b7c1e66a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:47.022003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca6379-09f7-48f5-87c8-b38b7c1e66a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:15:47.023564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca6379-09f7-48f5-87c8-b38b7c1e66a1 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:15:47.033282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 768/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:15:48.118034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0154-25a1-415c-b30d-5ee27b30d428 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:48.118592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0154-25a1-415c-b30d-5ee27b30d428 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:48.118592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0154-25a1-415c-b30d-5ee27b30d428 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:48.119888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:15:48.126690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff8ccb-529a-43fa-8e9d-3013628387fa None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:48.127130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff8ccb-529a-43fa-8e9d-3013628387fa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:48.127244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff8ccb-529a-43fa-8e9d-3013628387fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:48.147240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-52ff8ccb-529a-43fa-8e9d-3013628387fa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:15:48.148416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52ff8ccb-529a-43fa-8e9d-3013628387fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:15:48.157197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:15:48.321869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0154-25a1-415c-b30d-5ee27b30d428 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:15:48.336012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0154-25a1-415c-b30d-5ee27b30d428 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:15:48.341353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9208-5379-4dc6-91f1-12d0e86c7fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:15:48.341949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9208-5379-4dc6-91f1-12d0e86c7fee service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:48.342224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9208-5379-4dc6-91f1-12d0e86c7fee service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:48.342494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9208-5379-4dc6-91f1-12d0e86c7fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:48.351066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9208-5379-4dc6-91f1-12d0e86c7fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:15:48.352694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9208-5379-4dc6-91f1-12d0e86c7fee service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:15:48.362611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 747/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:15:48.623638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5fcf-252b-4735-8c11-efdf78edf2b8 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:48.623893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5fcf-252b-4735-8c11-efdf78edf2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:48.624156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5fcf-252b-4735-8c11-efdf78edf2b8 None None] PATH_INFO: `/v3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:48.625453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 770/1517] 10.222.0.13 () {54 vars in 925 bytes} [Sat Oct 1 04:15:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:15:48.631560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab208-1ce7-4279-9747-e32fc61b1a21 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:48.631845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab208-1ce7-4279-9747-e32fc61b1a21 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:48.632151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab208-1ce7-4279-9747-e32fc61b1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:48.693021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-888ab208-1ce7-4279-9747-e32fc61b1a21 None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:15:48.694223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-888ab208-1ce7-4279-9747-e32fc61b1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:15:48.710911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:15:48.765515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 748/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Sat Oct 1 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:15:52.288151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab16ea-4464-45a9-b6ce-299a08542852 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:52.288610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab16ea-4464-45a9-b6ce-299a08542852 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:52.288737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab16ea-4464-45a9-b6ce-299a08542852 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:52.290138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 771/1519] 10.222.0.27 () {54 vars in 961 bytes} [Sat Oct 1 04:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:15:52.295134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb0c4-d7b2-4784-b588-bc493e4928a7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:52.295570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb0c4-d7b2-4784-b588-bc493e4928a7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:52.296341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fb0c4-d7b2-4784-b588-bc493e4928a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:52.315752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d24fb0c4-d7b2-4784-b588-bc493e4928a7 None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:15:52.317018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d24fb0c4-d7b2-4784-b588-bc493e4928a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:15:52.326231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 749/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Sat Oct 1 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:15:52.333976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab16ea-4464-45a9-b6ce-299a08542852 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:15:52.347199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab16ea-4464-45a9-b6ce-299a08542852 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:15:52.352114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e776c4-2c88-44b3-9974-d0d18e8df7f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:15:52.352700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e776c4-2c88-44b3-9974-d0d18e8df7f0 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:52.352974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e776c4-2c88-44b3-9974-d0d18e8df7f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:52.353239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e776c4-2c88-44b3-9974-d0d18e8df7f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:52.361702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e776c4-2c88-44b3-9974-d0d18e8df7f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:15:52.363275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e776c4-2c88-44b3-9974-d0d18e8df7f0 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:15:52.372738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 772/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:15:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:15:59.826815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c12c-c356-43d5-b944-47d0aaf465d0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:59.827330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c12c-c356-43d5-b944-47d0aaf465d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:59.827439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c12c-c356-43d5-b944-47d0aaf465d0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:59.829419 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:15:59.835836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa655636-46be-4114-81c9-27b20161b0d7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:15:59.836281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa655636-46be-4114-81c9-27b20161b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:15:59.836413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa655636-46be-4114-81c9-27b20161b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:15:59.855764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-aa655636-46be-4114-81c9-27b20161b0d7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:15:59.857005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-aa655636-46be-4114-81c9-27b20161b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:15:59.864700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:16:00.018213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c12c-c356-43d5-b944-47d0aaf465d0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:16:00.033020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c12c-c356-43d5-b944-47d0aaf465d0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:16:00.038293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375212-83a6-4e13-a263-63a8c3740aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:16:00.038883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375212-83a6-4e13-a263-63a8c3740aab service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:00.039157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375212-83a6-4e13-a263-63a8c3740aab service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:00.039421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375212-83a6-4e13-a263-63a8c3740aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:00.047241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375212-83a6-4e13-a263-63a8c3740aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:16:00.048828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375212-83a6-4e13-a263-63a8c3740aab service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:16:00.057961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 751/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:16:01.123354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fbe58-ef07-409e-8982-5bee85b69870 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:01.123886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fbe58-ef07-409e-8982-5bee85b69870 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:01.123886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fbe58-ef07-409e-8982-5bee85b69870 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:01.125816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 1 04:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:16:01.131820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e03975-da62-4cce-9e7d-0ca4461a8f4d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:01.132267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e03975-da62-4cce-9e7d-0ca4461a8f4d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:01.132459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e03975-da62-4cce-9e7d-0ca4461a8f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:01.151682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d4e03975-da62-4cce-9e7d-0ca4461a8f4d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:16:01.152911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d4e03975-da62-4cce-9e7d-0ca4461a8f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:01.161122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 1 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:16:01.312587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fbe58-ef07-409e-8982-5bee85b69870 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:16:01.326591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fbe58-ef07-409e-8982-5bee85b69870 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:16:01.331959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a82c5-81aa-41b7-a9a8-32daada487eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:16:01.332569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a82c5-81aa-41b7-a9a8-32daada487eb service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:01.332849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a82c5-81aa-41b7-a9a8-32daada487eb service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:01.333118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a82c5-81aa-41b7-a9a8-32daada487eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:01.340907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a82c5-81aa-41b7-a9a8-32daada487eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:16:01.342469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a82c5-81aa-41b7-a9a8-32daada487eb service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:16:01.352005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 775/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:16:05.483945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caf8f6-8694-4935-8c3c-f1fe35a7a08e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:05.484505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caf8f6-8694-4935-8c3c-f1fe35a7a08e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:05.484505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caf8f6-8694-4935-8c3c-f1fe35a7a08e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:05.486415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:16:05.491759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc058-e171-4807-91fb-0c19cfbee36b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:05.492187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc058-e171-4807-91fb-0c19cfbee36b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:05.492349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc058-e171-4807-91fb-0c19cfbee36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:05.513111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-333bc058-e171-4807-91fb-0c19cfbee36b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:16:05.514280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-333bc058-e171-4807-91fb-0c19cfbee36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:05.522450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:16:05.811608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caf8f6-8694-4935-8c3c-f1fe35a7a08e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:16:05.813329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-83caf8f6-8694-4935-8c3c-f1fe35a7a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:05.890436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caf8f6-8694-4935-8c3c-f1fe35a7a08e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:16:05.894607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a212b8-9ad5-4026-8e36-aec5a49f125b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:16:05.895198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a212b8-9ad5-4026-8e36-aec5a49f125b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:05.895471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a212b8-9ad5-4026-8e36-aec5a49f125b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:05.895739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a212b8-9ad5-4026-8e36-aec5a49f125b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:05.904352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a212b8-9ad5-4026-8e36-aec5a49f125b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:16:05.905756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a212b8-9ad5-4026-8e36-aec5a49f125b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:16:05.914881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 754/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:16:08.097931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1b26b-88f1-4281-8d84-8cd2838d0f73 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:08.098461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1b26b-88f1-4281-8d84-8cd2838d0f73 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:08.098461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1b26b-88f1-4281-8d84-8cd2838d0f73 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:08.099706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:16:08.105051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccb25c-ab11-4225-8c83-b279c3701db1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:08.105475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccb25c-ab11-4225-8c83-b279c3701db1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:08.105642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccb25c-ab11-4225-8c83-b279c3701db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:08.124598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7dccb25c-ab11-4225-8c83-b279c3701db1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:16:08.125773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7dccb25c-ab11-4225-8c83-b279c3701db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:08.134149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:16:08.427487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1b26b-88f1-4281-8d84-8cd2838d0f73 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:16:08.429268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e0e1b26b-88f1-4281-8d84-8cd2838d0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:08.442907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1b26b-88f1-4281-8d84-8cd2838d0f73 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:16:08.446429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138f58c-5595-4529-a010-a0afb037885a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:16:08.447020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138f58c-5595-4529-a010-a0afb037885a service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:08.447298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138f58c-5595-4529-a010-a0afb037885a service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:08.447569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138f58c-5595-4529-a010-a0afb037885a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:08.456311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138f58c-5595-4529-a010-a0afb037885a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:16:08.457716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138f58c-5595-4529-a010-a0afb037885a service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:16:08.466790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 778/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:16:12.128191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45e6d-238a-4418-93ef-4fbea0a64aa5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:12.128813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45e6d-238a-4418-93ef-4fbea0a64aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:12.128813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45e6d-238a-4418-93ef-4fbea0a64aa5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:12.130065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:16:12.135227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673bb11-5313-472b-b28a-d7550c177384 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:12.135690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673bb11-5313-472b-b28a-d7550c177384 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:12.135802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673bb11-5313-472b-b28a-d7550c177384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:12.155442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7673bb11-5313-472b-b28a-d7550c177384 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:16:12.156659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7673bb11-5313-472b-b28a-d7550c177384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:12.164836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:16:12.463088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45e6d-238a-4418-93ef-4fbea0a64aa5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:16:12.464784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9ae45e6d-238a-4418-93ef-4fbea0a64aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:12.529215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:12.542372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45e6d-238a-4418-93ef-4fbea0a64aa5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:16:12.545813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc543-8c39-40d5-a0fd-315cd2c5ba7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:16:12.546407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc543-8c39-40d5-a0fd-315cd2c5ba7e service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:12.546678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc543-8c39-40d5-a0fd-315cd2c5ba7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:12.546943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc543-8c39-40d5-a0fd-315cd2c5ba7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:12.555616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc543-8c39-40d5-a0fd-315cd2c5ba7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:16:12.557045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc543-8c39-40d5-a0fd-315cd2c5ba7e service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:16:12.566687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 757/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:16:14.698575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33f175-ca5f-4af1-bb9c-57faff4c877a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:14.699179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33f175-ca5f-4af1-bb9c-57faff4c877a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:14.699179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33f175-ca5f-4af1-bb9c-57faff4c877a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:14.700504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 1 04:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:16:14.705574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93896639-c7a8-424c-9369-fe7a658ff8d4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:14.705995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93896639-c7a8-424c-9369-fe7a658ff8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:14.706102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93896639-c7a8-424c-9369-fe7a658ff8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:14.725308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-93896639-c7a8-424c-9369-fe7a658ff8d4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:16:14.726487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-93896639-c7a8-424c-9369-fe7a658ff8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:14.734017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 1 04:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:16:15.030491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33f175-ca5f-4af1-bb9c-57faff4c877a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:16:15.032177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ab33f175-ca5f-4af1-bb9c-57faff4c877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:16:15.040256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=84 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:15.046488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33f175-ca5f-4af1-bb9c-57faff4c877a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:16:15.050022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327750ea-89fe-40fd-aada-4cb36ac52206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:16:15.050613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327750ea-89fe-40fd-aada-4cb36ac52206 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:16:15.050889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327750ea-89fe-40fd-aada-4cb36ac52206 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:16:15.051160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327750ea-89fe-40fd-aada-4cb36ac52206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:16:15.059846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327750ea-89fe-40fd-aada-4cb36ac52206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:16:15.061277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327750ea-89fe-40fd-aada-4cb36ac52206 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:16:15.070385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 781/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:16:24.719624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=11 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:25.066316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:41.476817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e278-22d4-40ac-81c5-758eaba63141 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.477540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e278-22d4-40ac-81c5-758eaba63141 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.477540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e278-22d4-40ac-81c5-758eaba63141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.504963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4080e278-22d4-40ac-81c5-758eaba63141 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.506190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4080e278-22d4-40ac-81c5-758eaba63141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.514835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 759/1540] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.523439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.524465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.524974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.541538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b53d7-fcfd-4a56-9f6f-1b2fd0b76762 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.541887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b53d7-fcfd-4a56-9f6f-1b2fd0b76762 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.542104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b53d7-fcfd-4a56-9f6f-1b2fd0b76762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.551113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.552606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.571038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 782/1541] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.573095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6c0b53d7-fcfd-4a56-9f6f-1b2fd0b76762 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.574337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c0b53d7-fcfd-4a56-9f6f-1b2fd0b76762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.576266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:41.589150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 760/1542] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.591783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962fe13-f718-4cad-89fa-558f478b62aa None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:41.598427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa667d-760c-41cf-a492-bee41b031cf1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.598712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa667d-760c-41cf-a492-bee41b031cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.598984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa667d-760c-41cf-a492-bee41b031cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.600036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:41.601086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.601536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.601973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.602794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:41.603273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:41.604491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:17:41.604491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:17:41.604491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:17:41.608484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800014e8-6ed1-44ae-8c87-2c99ad494556 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:41.625435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 783/1543] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:41.626070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dfaa667d-760c-41cf-a492-bee41b031cf1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.627713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52e7c4-b0f7-47a5-b43f-97626ae4f2f0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.627848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dfaa667d-760c-41cf-a492-bee41b031cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.628951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52e7c4-b0f7-47a5-b43f-97626ae4f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.629405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52e7c4-b0f7-47a5-b43f-97626ae4f2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.649675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 761/1544] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.650935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31991-a6bf-46e2-88cd-7a60e4d7170c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.651218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31991-a6bf-46e2-88cd-7a60e4d7170c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.651487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31991-a6bf-46e2-88cd-7a60e4d7170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.658339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ad52e7c4-b0f7-47a5-b43f-97626ae4f2f0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.659541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ad52e7c4-b0f7-47a5-b43f-97626ae4f2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.667349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 784/1545] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.668735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.669021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.669295 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.671217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ddb31991-a6bf-46e2-88cd-7a60e4d7170c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.672459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ddb31991-a6bf-46e2-88cd-7a60e4d7170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.681184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 762/1546] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.682388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a9868-89aa-4936-b31f-62c25f6b05fd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.682667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a9868-89aa-4936-b31f-62c25f6b05fd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.682934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a9868-89aa-4936-b31f-62c25f6b05fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.691563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.692004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.699798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 785/1547] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.700634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:41.706894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f22a9868-89aa-4936-b31f-62c25f6b05fd None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.708331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f22a9868-89aa-4936-b31f-62c25f6b05fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.709720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f1c50-3949-4eeb-babe-6140c4e01e6f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:41.714143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:41.714756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.715032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.715297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.715914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:41.716628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 763/1548] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.717830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:41.718069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38dda-2b0d-4792-b5be-c00738383cd6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.718357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38dda-2b0d-4792-b5be-c00738383cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.718629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38dda-2b0d-4792-b5be-c00738383cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.738410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-01f38dda-2b0d-4792-b5be-c00738383cd6 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.739598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-01f38dda-2b0d-4792-b5be-c00738383cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.747760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 764/1549] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.748990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f8d8-e5e3-4f5b-9af6-c9a45ade79e8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.749486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f8d8-e5e3-4f5b-9af6-c9a45ade79e8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.749486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f8d8-e5e3-4f5b-9af6-c9a45ade79e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.756061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 786/1550] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:41.756991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:41.770536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d465f8d8-e5e3-4f5b-9af6-c9a45ade79e8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.771719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d465f8d8-e5e3-4f5b-9af6-c9a45ade79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.818241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa024c-1df9-41a4-a6c1-66063bb26f26 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:41.823325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:41.824101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.824476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.824839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.825620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:41.826011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:41.827710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdac52-a47c-43be-895e-e138127f0171 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:41.835754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 765/1551] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.837477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c282d-7475-4fee-b76e-2806af8d5c01 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.837765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c282d-7475-4fee-b76e-2806af8d5c01 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.838340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c282d-7475-4fee-b76e-2806af8d5c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.843158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 787/1552] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:41.843158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb72f8-5a48-4639-8829-c9967dee3f53 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.843158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb72f8-5a48-4639-8829-c9967dee3f53 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.843158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb72f8-5a48-4639-8829-c9967dee3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.859835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-696c282d-7475-4fee-b76e-2806af8d5c01 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.861078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-696c282d-7475-4fee-b76e-2806af8d5c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.863254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-59eb72f8-5a48-4639-8829-c9967dee3f53 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.864434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-59eb72f8-5a48-4639-8829-c9967dee3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.868911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 766/1553] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.870068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ecfd-2ac2-4db8-a8ea-123405eb01ca None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.870346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ecfd-2ac2-4db8-a8ea-123405eb01ca None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.870615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ecfd-2ac2-4db8-a8ea-123405eb01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.872472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 788/1554] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.873665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.873954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.874227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.890408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1c34ecfd-2ac2-4db8-a8ea-123405eb01ca None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.891577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1c34ecfd-2ac2-4db8-a8ea-123405eb01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.894019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.895154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.899363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 767/1555] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.900556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1429d70-245f-4156-8a85-5716d47693a7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.900831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1429d70-245f-4156-8a85-5716d47693a7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.901097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1429d70-245f-4156-8a85-5716d47693a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.904122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 789/1556] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.904991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:41.916373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efedf3-8783-42dc-85ac-3d83fe354197 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:41.920589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c1429d70-245f-4156-8a85-5716d47693a7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.920944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:41.921528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.921759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1429d70-245f-4156-8a85-5716d47693a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.921880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.922067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.922671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:41.924254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:17:41.924254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:17:41.924254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:17:41.925449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:41.930338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 768/1557] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.931496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.931772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.932067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.948471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 790/1558] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:41.949292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:41.951664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:41.952866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:41.959223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde24c4-9062-4b41-a0d7-d892746c7ae7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:41.961227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 769/1559] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:41.962047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:41.964367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:41.965101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.965386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.965660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.966280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:41.968198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:41.971452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1247-42d6-45e3-a76c-e4989b819bb5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:41.975898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:41.976512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:41.976783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:41.977050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:41.977684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:41.977981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:41.979547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:41.991676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 770/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:41.992454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.002805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 791/1561] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:41 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.003761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.009231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226308e-7c02-427d-9168-ad70532e398d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.044678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:42.065011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.065615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.065998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.066265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.066891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:42.067188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.068478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b288d-2f95-4279-a1d7-c3d3ea5fb141 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.068823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.073097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.073703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.073982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.074253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.074895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:42.075197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.076811 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.082003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 771/1562] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:42.082809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.089654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 792/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:42.090587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.094749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2831-a504-481b-ab9a-ee1b6fbead6b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.100233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.100480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18e571-19b4-4317-8ea7-b2acb47c33d5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.100998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.101354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.101752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.102397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:42.102698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.104331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.105172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.105753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.106033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.106308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.106935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:42.107239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.108866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.117056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 772/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:42.117887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.134883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 793/1565] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:42.134883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.135156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:42.135156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709924af-7288-4d58-aeb1-e2998b36cb74 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.139244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3497c46-5e07-40cd-8aab-d7c2632a3145 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.140381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.141049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.141354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.141671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.142297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.143808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.143951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.144441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.144718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.144987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.145617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:42.145915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.147484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.154907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 773/1566] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.155685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.166280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 794/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:42.166280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.166541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9944945-89a0-4b41-83a9-71caca8984be admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.171101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.171694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.172026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.172348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.172724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf1b6-d1cb-4eb3-ad06-66ac1973a3ed admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.173512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.174549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:17:42.174549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:17:42.174549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:17:42.175831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.177914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.178494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.178804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.179064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.179678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.181723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.205305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 774/1569] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.205531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 795/1569] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.208926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.209061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.219170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66ced8-418d-44e9-b254-992a430fb6ed admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.271786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c25c-a4c3-4106-8a50-3373a35f4e77 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.274381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.274998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.275281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.275556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.276284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.276407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.276913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.277185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.277452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.278089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.278285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.280028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.307435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 796/1570] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.308381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.314379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 775/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.315200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.374075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eccc2-79ed-4277-b1ae-17084f14f7fd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.375052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dbe57-c8aa-464d-8586-b90ce63e29c6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.379374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.380007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.380285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.380400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.380554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.380915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.381192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.381292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.381463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.382079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.383233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.383982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.405967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:42.412811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 776/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.413656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.416952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 797/1573] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.417778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.460238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:42.481516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fc2fb-b346-48a3-a39d-9aa9e0e32c80 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.482552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc924d-963a-4f29-9d44-067ed1d5050f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.487348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.487683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.487978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.488258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.488376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.488529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.488708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.488839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.489177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.489464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.490769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.491347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.500602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 777/1574] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.501449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.510785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7cb11-5972-4cbf-8831-12bd1d0ed1f6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.516385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.517053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.517383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.517687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.518319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.519908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.525943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 798/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.525943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.532954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 778/1576] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.533840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.543540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edfab4-98f6-4cd8-947d-41e39987a0d8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.588587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50996e-1e00-41b8-ad16-369fe1db5e57 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.593338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.593936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.594216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.594486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.595650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.597662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.601709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.602317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.602624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.602898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.603522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.605475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.618252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 799/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.619267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.626670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 779/1578] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.627686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.629721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e32c1-4b90-4e3d-8ed5-471e798e56cd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.634365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.634950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.635226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.635495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.636409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.637725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d214c0-c605-47b7-8393-7cdda35400b8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.638350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.642370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.642953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.643230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.643522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.644143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.646079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.659066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 800/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.659869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.668880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 780/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.669254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50612aa2-cd0c-4a61-92df-407962b200c1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.669643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.677620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.678384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.678835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.679119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.679489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d435c4-6bc7-4ea8-98b8-bf5ce69b8c2a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.679777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.681741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.684050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.684677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.684950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.685221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] PATH_INFO: `/v3/projects/5528671fcc4246698944e162d776cbb7/users/20ceef968eca4ebdb26e713a4e3ef3f9/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.700643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5528671fcc4246698944e162d776cbb7, user_id=20ceef968eca4ebdb26e713a4e3ef3f9, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.701733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:17:42.701733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:17:42.701733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:17:42.703708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 801/1581] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.703829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.705049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.715828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19eed9-f7cc-44d0-abbf-c1ed8d01dc2d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.717689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 781/1582] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:42 2022] PUT /identity/v3/projects/5528671fcc4246698944e162d776cbb7/users/20ceef968eca4ebdb26e713a4e3ef3f9/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:42.718341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.757629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:42.782464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.783031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.783306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.783576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.784701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.786214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.787849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309ff0f-5927-4bf7-a60e-b77ec83eb938 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.792411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.793011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.793283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.793551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.794180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.795750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.806283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 782/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.807111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.807979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 802/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:42.809051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.819834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b0bf-8f8c-47b2-a2e0-0a1eecae482b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.820099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c525f-a924-4a90-96b4-abfe40449882 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.824600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.824737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.825248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.825366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.825526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.825619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.825792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.825908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.826419 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.826522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.828034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.828178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.830426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:42.839447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 803/1585] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.840335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.843143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 783/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.844003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.851042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951708-07da-4399-8be6-878e9456941c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.853611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee24d-cf6d-4f27-b57b-f456b68f023a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.855719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.856332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.856613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.856887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.857513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.858330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2aa56-69bd-46f3-a675-458661264f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.858921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2aa56-69bd-46f3-a675-458661264f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.859086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.859182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2aa56-69bd-46f3-a675-458661264f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.859455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2aa56-69bd-46f3-a675-458661264f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.860118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2aa56-69bd-46f3-a675-458661264f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.862194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2aa56-69bd-46f3-a675-458661264f3a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.870098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 804/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.870965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.872571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 784/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.873610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.873892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.874164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.882933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf080ebd-ac0c-48d4-a4d8-33e0cb0d3831 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.887838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.888576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.888981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.889257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.889880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.891433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.901901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] MFA Rules not processed for user `20ceef968eca4ebdb26e713a4e3ef3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:42.903106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:42.903217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 805/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:42.906282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.913117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a582-89c5-4dd7-812c-7701db2d6363 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:42.917893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:42.918597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:42.918945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:42.919289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] PATH_INFO: `/v3/projects/4f39dde36a394773b81c59bec6ef3020/users/f3ab14f5de7f41fb8a4665ffabf439e8/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:42.934333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f39dde36a394773b81c59bec6ef3020, user_id=f3ab14f5de7f41fb8a4665ffabf439e8, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:42.937084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:42.951090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 806/1590] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:42 2022] PUT /identity/v3/projects/4f39dde36a394773b81c59bec6ef3020/users/f3ab14f5de7f41fb8a4665ffabf439e8/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:42.956943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.970145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 785/1591] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:42.971105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:42.982132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc44fe0-e9cb-4d2e-9953-71a63d75b5f7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.033397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee760-604d-4a2b-9d49-e10d0e3ea96a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.038233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.038839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.039116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.039386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.040055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.041674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.045677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.046390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.046736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.047025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.047663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.049365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.051593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 807/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.052988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.060034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 786/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.060842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.062314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da8886-6cdc-4629-afee-f59172581c10 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.067546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.068157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.068437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.068708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.069336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.070901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.071070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e028f-8c5c-43d4-8c03-24f8ef683b36 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.076618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.077211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.077535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.077817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.078448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.080741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.081210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 808/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.081210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.091025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 787/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.091709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.096552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ad44d-fa30-4d82-87da-6fb1964d8127 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.101085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe6c98-38d8-4079-ab34-67ae8af4bf45 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.101206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472aa02-7dda-45f9-a3fa-223e24ca9787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.101688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472aa02-7dda-45f9-a3fa-223e24ca9787 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.101973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472aa02-7dda-45f9-a3fa-223e24ca9787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.102240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472aa02-7dda-45f9-a3fa-223e24ca9787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.102866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472aa02-7dda-45f9-a3fa-223e24ca9787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.104485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472aa02-7dda-45f9-a3fa-223e24ca9787 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.105896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84727cec-ad4b-40da-b149-41be42df100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.106472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727cec-ad4b-40da-b149-41be42df100b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.106863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727cec-ad4b-40da-b149-41be42df100b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.107143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727cec-ad4b-40da-b149-41be42df100b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.107766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84727cec-ad4b-40da-b149-41be42df100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.109349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84727cec-ad4b-40da-b149-41be42df100b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.114925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 809/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.115958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.116257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.116524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.122770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 788/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.122770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd82de-7b6a-4dbc-8347-477bdfbdd03e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.122770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd82de-7b6a-4dbc-8347-477bdfbdd03e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.122770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd82de-7b6a-4dbc-8347-477bdfbdd03e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.123209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 789/1598] 10.222.0.27 () {54 vars in 961 bytes} [Sat Oct 1 04:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:17:43.123847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd82de-7b6a-4dbc-8347-477bdfbdd03e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.137487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd82de-7b6a-4dbc-8347-477bdfbdd03e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.142291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.142857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.143134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.143406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.144073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.144392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] MFA Rules not processed for user `f3ab14f5de7f41fb8a4665ffabf439e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.145609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.145712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.155816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 790/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:43.156795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.166937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b87c17-4f6e-4adc-88ea-4770228f431f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.171742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.172400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.172680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.173034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] PATH_INFO: `/v3/projects/2be3aa2d49364ee7b227a587b452d449/users/0371c2d52c13449da4ce66a67c988698/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.180338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:43.187920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be3aa2d49364ee7b227a587b452d449, user_id=0371c2d52c13449da4ce66a67c988698, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.191489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.203726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 791/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:43 2022] PUT /identity/v3/projects/2be3aa2d49364ee7b227a587b452d449/users/0371c2d52c13449da4ce66a67c988698/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:43.204646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.224717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 810/1601] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.225591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.232282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:43.236416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602b10e-7331-437d-8caf-a246bd278f6a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.278568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a3f6-b3e2-4a99-91bb-617480bd423c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.283990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.284624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.284873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.285147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] PATH_INFO: `/v3/projects/54c4a8ecc38f4f7795190dabee5b318f/users/5ac2c0f2fcb349c68604724730d274df/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.293977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.294636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.294917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.295196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] PATH_INFO: `/v3/projects/30a7184818594203904e2d3762aac40f/users/a8283e0d06ed4bf7914f2f191291b7c7/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.299467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c4a8ecc38f4f7795190dabee5b318f, user_id=5ac2c0f2fcb349c68604724730d274df, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.302141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.311353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a7184818594203904e2d3762aac40f, user_id=a8283e0d06ed4bf7914f2f191291b7c7, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.314733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.316049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 792/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:43 2022] PUT /identity/v3/projects/54c4a8ecc38f4f7795190dabee5b318f/users/5ac2c0f2fcb349c68604724730d274df/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:43.316835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.328930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 811/1603] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:43 2022] PUT /identity/v3/projects/30a7184818594203904e2d3762aac40f/users/a8283e0d06ed4bf7914f2f191291b7c7/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:43.329812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.391587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99ac5f-210f-47c8-bf16-97276f410574 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.396309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4360e7-bb7c-4b6e-b82e-3b98ec6a692e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.396656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191f868-a209-4fae-a225-9f0eaac5d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.397316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f868-a209-4fae-a225-9f0eaac5d19d admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.397596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f868-a209-4fae-a225-9f0eaac5d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.397868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f868-a209-4fae-a225-9f0eaac5d19d admin admin] PATH_INFO: `/v3/projects/d0bb6e266bd7463a82a9b901527fe4fe/users/9e21985df0d94752864f7858ca71e05d/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.402646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.403331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.403606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.403872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] PATH_INFO: `/v3/projects/c0476df6a9b44cc99c238fb9cee270c5/users/422d4d574cdd48979d1ccc57de307637/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.414509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191f868-a209-4fae-a225-9f0eaac5d19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bb6e266bd7463a82a9b901527fe4fe, user_id=9e21985df0d94752864f7858ca71e05d, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.417225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191f868-a209-4fae-a225-9f0eaac5d19d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.418367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0476df6a9b44cc99c238fb9cee270c5, user_id=422d4d574cdd48979d1ccc57de307637, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.421107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.430880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 812/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:43 2022] PUT /identity/v3/projects/d0bb6e266bd7463a82a9b901527fe4fe/users/9e21985df0d94752864f7858ca71e05d/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:43.432486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.432953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.433300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.434345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 793/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:43 2022] PUT /identity/v3/projects/c0476df6a9b44cc99c238fb9cee270c5/users/422d4d574cdd48979d1ccc57de307637/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:43.435050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.474509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.475722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.496816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:43.498509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363409b-5f66-4746-8aa5-78cb45f31856 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.503537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050c05c-ad0a-4fc1-a45f-c20c2d15ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.504261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c05c-ad0a-4fc1-a45f-c20c2d15ea7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.504536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c05c-ad0a-4fc1-a45f-c20c2d15ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.504815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c05c-ad0a-4fc1-a45f-c20c2d15ea7b admin admin] PATH_INFO: `/v3/projects/315314212d2c4f8ab69560bb730e439d/users/51129e120cd14371b995bcc451264981/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.522073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050c05c-ad0a-4fc1-a45f-c20c2d15ea7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=315314212d2c4f8ab69560bb730e439d, user_id=51129e120cd14371b995bcc451264981, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.524904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050c05c-ad0a-4fc1-a45f-c20c2d15ea7b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.538909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 794/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:43 2022] PUT /identity/v3/projects/315314212d2c4f8ab69560bb730e439d/users/51129e120cd14371b995bcc451264981/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:43.540172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b853a6-1484-4133-9992-a509ebdc845e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.540457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b853a6-1484-4133-9992-a509ebdc845e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.540728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b853a6-1484-4133-9992-a509ebdc845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.549575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:43.549718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 813/1607] 10.222.0.27 () {58 vars in 1058 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.550539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.561118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a718-a4bc-4145-a5cb-1fa1d5b331ba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.572696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f2b853a6-1484-4133-9992-a509ebdc845e None None] MFA Rules not processed for user `0371c2d52c13449da4ce66a67c988698`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.573978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2b853a6-1484-4133-9992-a509ebdc845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.620915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e981d-41fd-4cff-854b-410e22032345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.621651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e981d-41fd-4cff-854b-410e22032345 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.622039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e981d-41fd-4cff-854b-410e22032345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.622402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e981d-41fd-4cff-854b-410e22032345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.623166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e981d-41fd-4cff-854b-410e22032345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.625399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e981d-41fd-4cff-854b-410e22032345 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.640837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 795/1608] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.640837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee3f6-4749-458f-a660-8970970a0349 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.640837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee3f6-4749-458f-a660-8970970a0349 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.640837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee3f6-4749-458f-a660-8970970a0349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.656918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 814/1609] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:43.656918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119186d0-6924-47eb-b8dc-d3662cbb7cb4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.656918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119186d0-6924-47eb-b8dc-d3662cbb7cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.656918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119186d0-6924-47eb-b8dc-d3662cbb7cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.658806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f46ee3f6-4749-458f-a660-8970970a0349 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.660039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f46ee3f6-4749-458f-a660-8970970a0349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.683156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-119186d0-6924-47eb-b8dc-d3662cbb7cb4 None None] MFA Rules not processed for user `a8283e0d06ed4bf7914f2f191291b7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.684363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-119186d0-6924-47eb-b8dc-d3662cbb7cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.721895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 796/1610] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.721895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ccd5-5d5f-4f5e-939a-1d56927ba936 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.721895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ccd5-5d5f-4f5e-939a-1d56927ba936 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.721895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ccd5-5d5f-4f5e-939a-1d56927ba936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.739205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-38f8ccd5-5d5f-4f5e-939a-1d56927ba936 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.740541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-38f8ccd5-5d5f-4f5e-939a-1d56927ba936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.748137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 797/1611] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.749473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.749822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.750145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.751493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 815/1612] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.752875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.753192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.753425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.776159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.777402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.780741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] MFA Rules not processed for user `422d4d574cdd48979d1ccc57de307637`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:43.781961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:43.786501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 816/1613] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.787608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.820189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:43.851842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 798/1614] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:43.852526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.863005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117438f3-b94d-4d14-b108-3a1eb3bab45f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.865588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77be7f-8cff-4648-aa1d-eba8d7c76aca None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.867525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.868262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.868545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.868842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.869456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.871048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.871482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.871646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.871927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.872223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.887630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:43.900719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 799/1615] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:43.901501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.934281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.935878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.945337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 817/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:43.948839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:43.963961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b496d-8ca1-4e72-8840-a1856f934b01 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:43.968616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:43.969219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:43.970222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:43.970417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:43.971003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:43.972953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:43.996836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 800/1617] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:43 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:43.997761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.010995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028e90-6432-4197-bffc-5e823e633f9b service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.058725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e974c3-4511-4176-a848-eeb473ffe255 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.062982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.064494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.064987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.065468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.065581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0724-76b2-412a-9562-9bbeb4fd5f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.066096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0724-76b2-412a-9562-9bbeb4fd5f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.066369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0724-76b2-412a-9562-9bbeb4fd5f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.066639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0724-76b2-412a-9562-9bbeb4fd5f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.075723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae0724-76b2-412a-9562-9bbeb4fd5f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.076953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.077204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae0724-76b2-412a-9562-9bbeb4fd5f16 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.078678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.086861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 818/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:44.087861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14b58-1a1b-4733-83c9-36afafcefa03 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.088168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14b58-1a1b-4733-83c9-36afafcefa03 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.088436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14b58-1a1b-4733-83c9-36afafcefa03 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.089815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 819/1619] 10.222.0.27 () {54 vars in 961 bytes} [Sat Oct 1 04:17:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:17:44.090336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14b58-1a1b-4733-83c9-36afafcefa03 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.099714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 801/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:44.101233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.101497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14b58-1a1b-4733-83c9-36afafcefa03 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.105374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.105956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.106231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.106498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.116225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7685-0822-40dd-9f26-840a75a761fd service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.117829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.119460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.122118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.122851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.123228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.123603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.124656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.127731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.132726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 820/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:44.133613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.144833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c0f6b-6049-45db-8bb1-f0c3b0e3cad6 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.151750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ad8f0-6c99-48bb-a00e-a5f91402380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.152801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ad8f0-6c99-48bb-a00e-a5f91402380d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.153157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ad8f0-6c99-48bb-a00e-a5f91402380d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.153495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ad8f0-6c99-48bb-a00e-a5f91402380d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.154224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ad8f0-6c99-48bb-a00e-a5f91402380d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.156398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ad8f0-6c99-48bb-a00e-a5f91402380d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.167043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:44.175597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 802/1622] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:44 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:44.175597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.200219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 821/1623] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:44 2022] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:44.209191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19e967-c67c-4cce-987e-647215699761 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.209191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19e967-c67c-4cce-987e-647215699761 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.209191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19e967-c67c-4cce-987e-647215699761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.244394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7f19e967-c67c-4cce-987e-647215699761 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:44.246627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7f19e967-c67c-4cce-987e-647215699761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:44.279173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158cbcf-8f5b-4b14-a0db-863018a90316 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.284879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.285575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.285936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.286232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.286883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.288555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.301400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 803/1624] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:44.302531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.308447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:44.314444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e66269-7f06-4cf1-afe7-3a48d786cbfe admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.320254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c063480-fadc-460b-a0d4-c7c1ba767ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.320980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c063480-fadc-460b-a0d4-c7c1ba767ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.321639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c063480-fadc-460b-a0d4-c7c1ba767ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.322059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c063480-fadc-460b-a0d4-c7c1ba767ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.323302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c063480-fadc-460b-a0d4-c7c1ba767ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.325698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c063480-fadc-460b-a0d4-c7c1ba767ed7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.333768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 822/1625] 10.222.0.27 () {58 vars in 1058 bytes} [Sat Oct 1 04:17:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:44.334442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19e967-c67c-4cce-987e-647215699761 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.346776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19e967-c67c-4cce-987e-647215699761 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.355450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 804/1626] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:44 2022] POST /identity/v3/users => generated 292 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:44.355624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.355624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.355624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.355879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647da9c-f691-403e-b03e-e5f1df082715 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.356390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.356574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647da9c-f691-403e-b03e-e5f1df082715 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.356574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647da9c-f691-403e-b03e-e5f1df082715 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.356718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.356718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.360242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 805/1627] 10.222.0.27 () {54 vars in 912 bytes} [Sat Oct 1 04:17:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:17:44.362553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647da9c-f691-403e-b03e-e5f1df082715 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.368415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 823/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:44.369269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.378690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647da9c-f691-403e-b03e-e5f1df082715 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.384436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbf1f3-1cdf-43a0-998e-017e8cc5d52f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.385402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.386068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.386604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.386874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] PATH_INFO: `/v3/projects/2c680858f2da4758a0bb9d00e701febe/users/b14240dc964f4475a475016453f5d232/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.394362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f340-0ddc-4352-85ab-cc0584e865d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.395073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f340-0ddc-4352-85ab-cc0584e865d5 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.395592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f340-0ddc-4352-85ab-cc0584e865d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.395754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f340-0ddc-4352-85ab-cc0584e865d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.404959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c680858f2da4758a0bb9d00e701febe, user_id=b14240dc964f4475a475016453f5d232, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.407819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.423426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 806/1629] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:44 2022] PUT /identity/v3/projects/2c680858f2da4758a0bb9d00e701febe/users/b14240dc964f4475a475016453f5d232/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:44.424409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.472809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f340-0ddc-4352-85ab-cc0584e865d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.474662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f340-0ddc-4352-85ab-cc0584e865d5 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.484881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 824/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:44.494130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.494642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.496133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.502269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07804306-85fe-4c2f-8def-5a7ed059b9f1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.508635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.509960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.510613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.510940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.512953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.515033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.529520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 807/1631] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:44.530509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:44.532019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:44.534160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.545527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2950b-d4fc-412c-b979-286d97f0a1c5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.562164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.563379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.564372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.564712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] PATH_INFO: `/v3/projects/bfd1145641d04e0f871dad1902d62cdc/users/daf9b7c1cd944ffda61e23aade3fa3f7/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.591534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd1145641d04e0f871dad1902d62cdc, user_id=daf9b7c1cd944ffda61e23aade3fa3f7, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.595258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.612843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 808/1632] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:44 2022] PUT /identity/v3/projects/bfd1145641d04e0f871dad1902d62cdc/users/daf9b7c1cd944ffda61e23aade3fa3f7/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:44.616264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.650353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 825/1633] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:17:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:44.652260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.659788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:44.664954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908dd56-7ae7-4f28-a668-8cf36271672f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.754828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d957-d29b-4f70-81d9-db1e7458bfe8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.760602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.761500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.761715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5d24f-36d0-455b-8b32-20ea3aad51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.761904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.762186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.762729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d24f-36d0-455b-8b32-20ea3aad51c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.763151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d24f-36d0-455b-8b32-20ea3aad51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.763272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.763590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d24f-36d0-455b-8b32-20ea3aad51c1 admin admin] PATH_INFO: `/v3/projects/ea3fdf4d50594ec3b24320da779f2556/users/0604bfceb95a4a5daf53e4bf2b16f8e5/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.764992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.778386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 809/1634] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:44.779317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.781739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5d24f-36d0-455b-8b32-20ea3aad51c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3fdf4d50594ec3b24320da779f2556, user_id=0604bfceb95a4a5daf53e4bf2b16f8e5, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.787278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5d24f-36d0-455b-8b32-20ea3aad51c1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.791960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3532b1e-82d8-408c-8868-488e31141a06 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.797585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.798264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.798549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.798822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.799564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.801359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:44.826897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 810/1635] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:44.827896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.832287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 826/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:44 2022] PUT /identity/v3/projects/ea3fdf4d50594ec3b24320da779f2556/users/0604bfceb95a4a5daf53e4bf2b16f8e5/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:44.834360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd93af-dfe8-4214-827d-2c9bf61aa49c None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.834664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd93af-dfe8-4214-827d-2c9bf61aa49c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.834907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd93af-dfe8-4214-827d-2c9bf61aa49c None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.836264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 827/1637] 10.222.0.27 () {54 vars in 912 bytes} [Sat Oct 1 04:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:17:44.842328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd93af-dfe8-4214-827d-2c9bf61aa49c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:44.860402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:44.942582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cd6c4-86bc-4134-a0a0-28652e6f9840 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.952938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd93af-dfe8-4214-827d-2c9bf61aa49c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:44.962139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:44.963099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:44.963444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:44.964390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] PATH_INFO: `/v3/projects/2c680858f2da4758a0bb9d00e701febe/users/b14240dc964f4475a475016453f5d232/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:44.974711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c680858f2da4758a0bb9d00e701febe, user_id=b14240dc964f4475a475016453f5d232, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:44.984142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.000629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 828/1638] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:44 2022] PUT /identity/v3/projects/2c680858f2da4758a0bb9d00e701febe/users/b14240dc964f4475a475016453f5d232/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:45.001183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.026032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf54d0-1bae-4603-b0a4-16bf7a173ffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.026967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf54d0-1bae-4603-b0a4-16bf7a173ffb service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.027262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf54d0-1bae-4603-b0a4-16bf7a173ffb service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.027624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf54d0-1bae-4603-b0a4-16bf7a173ffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.097226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09529997-886c-4dd6-9adc-5ea3a300d3c3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.104680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.105765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.106247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.108202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] PATH_INFO: `/v3/projects/bfd1145641d04e0f871dad1902d62cdc/users/daf9b7c1cd944ffda61e23aade3fa3f7/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.111947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd1145641d04e0f871dad1902d62cdc, user_id=daf9b7c1cd944ffda61e23aade3fa3f7, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.114922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.147471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 829/1639] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:45 2022] PUT /identity/v3/projects/bfd1145641d04e0f871dad1902d62cdc/users/daf9b7c1cd944ffda61e23aade3fa3f7/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:45.148949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.170441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:45.198294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf54d0-1bae-4603-b0a4-16bf7a173ffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.200072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf54d0-1bae-4603-b0a4-16bf7a173ffb service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.214130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 811/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:45.215864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42c8b-192c-49f6-bc3a-0d39ae60792c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.217033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42c8b-192c-49f6-bc3a-0d39ae60792c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.217410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42c8b-192c-49f6-bc3a-0d39ae60792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.249145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2db42c8b-192c-49f6-bc3a-0d39ae60792c None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:45.255048 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2db42c8b-192c-49f6-bc3a-0d39ae60792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:45.303807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7ff3d-66d4-4a03-9cbb-d5abae1cf775 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.316830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c36e9f-ef89-4dcf-ba33-67f0f0ad7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.317797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36e9f-ef89-4dcf-ba33-67f0f0ad7e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.318550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36e9f-ef89-4dcf-ba33-67f0f0ad7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.319038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36e9f-ef89-4dcf-ba33-67f0f0ad7e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.319889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c36e9f-ef89-4dcf-ba33-67f0f0ad7e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.321729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c36e9f-ef89-4dcf-ba33-67f0f0ad7e36 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.337043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 830/1641] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:45.338624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.339111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.340127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.371169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 812/1642] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:45.372543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.372829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.373152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.388970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] MFA Rules not processed for user `b14240dc964f4475a475016453f5d232`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:45.389703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:45.392411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:45.410052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] MFA Rules not processed for user `daf9b7c1cd944ffda61e23aade3fa3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:45.411281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:45.492546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 831/1643] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:45.493719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.506860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e45d10-7a4b-4cae-82f3-52b093e279ca None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.512799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.515526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.515526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.515526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] PATH_INFO: `/v3/projects/ea3fdf4d50594ec3b24320da779f2556/users/0604bfceb95a4a5daf53e4bf2b16f8e5/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.526478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3fdf4d50594ec3b24320da779f2556, user_id=0604bfceb95a4a5daf53e4bf2b16f8e5, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.529650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.551120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 832/1644] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:45 2022] PUT /identity/v3/projects/ea3fdf4d50594ec3b24320da779f2556/users/0604bfceb95a4a5daf53e4bf2b16f8e5/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:45.551120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.563990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 813/1645] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:45.563990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.627887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291fe3d-7fdf-4dd8-9da6-e5ab686f0166 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.629019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee087-a51f-4a44-ba63-b295a2290f01 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.632772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.632904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf352e-e694-45a3-a6a0-e33b4b443067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.633396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.633501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf352e-e694-45a3-a6a0-e33b4b443067 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.633668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.633766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf352e-e694-45a3-a6a0-e33b4b443067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.633941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.634050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf352e-e694-45a3-a6a0-e33b4b443067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.672211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:45.715739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.717004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf352e-e694-45a3-a6a0-e33b4b443067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.717401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.718458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf352e-e694-45a3-a6a0-e33b4b443067 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.730315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 833/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:45.731229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 814/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:45.732670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.732952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.733658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.734232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.769568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] MFA Rules not processed for user `0604bfceb95a4a5daf53e4bf2b16f8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:45.770838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:45.817026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:45.844202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b44a-57b8-4cbd-8297-729b39b9bbad service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.851177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.851408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.851609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.851889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] PATH_INFO: `/v3/users/20ceef968eca4ebdb26e713a4e3ef3f9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.853088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ceef968eca4ebdb26e713a4e3ef3f9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:45.855661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:45.884700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 815/1648] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:45.885855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:45.907008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68f364-ccce-415e-96c2-acb109f3d892 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:45.915152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:45.916060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:45.916215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:45.916491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:45.981088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ceef968eca4ebdb26e713a4e3ef3f9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:45.984248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ceef968eca4ebdb26e713a4e3ef3f9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:45.999719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ceef968eca4ebdb26e713a4e3ef3f9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.006247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ceef968eca4ebdb26e713a4e3ef3f9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.028707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2c43f021-9d2a-45e7-9d3f-5e64bd1f0441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ceef968eca4ebdb26e713a4e3ef3f9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.069625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 834/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:45 2022] DELETE /identity/v3/users/20ceef968eca4ebdb26e713a4e3ef3f9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:46.071307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:46.071603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:46.071882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:46.077090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:46.082733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:46.105124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 816/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:46.112672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:46.113942 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:46.224916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:46.280779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 835/1651] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:46.291275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:46.302458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:46.307607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd75b1-1dd2-4d48-88dd-af08a5dcca04 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:46.321151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:46.332945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:46.333831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:46.334709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:46.335700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] PATH_INFO: `/v3/users/f3ab14f5de7f41fb8a4665ffabf439e8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:46.340462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ab14f5de7f41fb8a4665ffabf439e8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:46.341938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:17:46.341938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Oct 01 04:17:46.341938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: Oct 01 04:17:46.346519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:46.453081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d24d00-f109-48e0-b9da-df492f61789f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:46.463444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:46.465362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:46.466863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:46.467178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:46.473659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:46.496194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ab14f5de7f41fb8a4665ffabf439e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.520175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ab14f5de7f41fb8a4665ffabf439e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.521035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ab14f5de7f41fb8a4665ffabf439e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.547398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ab14f5de7f41fb8a4665ffabf439e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.549388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4795555b-b4b4-43e8-9d7f-db66b22fc56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ab14f5de7f41fb8a4665ffabf439e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:46.627405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:46.627405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:46.646791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 836/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:46.647662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:46.649289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 817/1653] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:46 2022] DELETE /identity/v3/users/f3ab14f5de7f41fb8a4665ffabf439e8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:46.652884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:46.654982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:46.655375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:46.656016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:46.687498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:46.690872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:46.776851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:46.804721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e39c-2244-4929-93f8-0a09607e48ba service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:46.893200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 818/1654] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:46.919056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:46.920539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:46.993743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:47.011598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:47.012077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:47.012361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:47.018546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:47.027405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:47.074603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:47.076297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:47.111534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 837/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:47.117248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2f1a8-f4bc-49f4-ad29-637ed28bc1a3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:47.122322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:47.123208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:47.123608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:47.123922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:47.146360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:47.149196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:47.168732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 819/1656] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:17:47.657651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:47.659559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:47.679164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542900d-033c-4f1a-a3b6-de5841a40542 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:47.691762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:47.692556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:47.692899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:47.694318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] PATH_INFO: `/v3/users/422d4d574cdd48979d1ccc57de307637` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:47.696377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422d4d574cdd48979d1ccc57de307637)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:47.700785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:47.852053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422d4d574cdd48979d1ccc57de307637'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:47.853170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422d4d574cdd48979d1ccc57de307637'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:47.885739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422d4d574cdd48979d1ccc57de307637'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:47.888356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422d4d574cdd48979d1ccc57de307637'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:47.906712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93914d92-4cae-40d8-a764-6202f2858168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422d4d574cdd48979d1ccc57de307637'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:47.918942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:47.921184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:47.947401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a709-2a19-4060-af3c-b7f4b4784340 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:47.958466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:47.959280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:47.959569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:47.959920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] PATH_INFO: `/v3/users/0371c2d52c13449da4ce66a67c988698` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:47.961260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 838/1657] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:47 2022] DELETE /identity/v3/users/422d4d574cdd48979d1ccc57de307637 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:47.966773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0371c2d52c13449da4ce66a67c988698)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:47.968093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:47.977752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d279a-f962-4736-881a-b9527196298c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:47.978196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d279a-f962-4736-881a-b9527196298c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:47.978642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d279a-f962-4736-881a-b9527196298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:48.017672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f69d279a-f962-4736-881a-b9527196298c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:48.019420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f69d279a-f962-4736-881a-b9527196298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.113569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0371c2d52c13449da4ce66a67c988698'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:48.132760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0371c2d52c13449da4ce66a67c988698'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:48.133970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0371c2d52c13449da4ce66a67c988698'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:48.158104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 839/1658] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:48.162234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0371c2d52c13449da4ce66a67c988698'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:48.164212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7fc8243f-d84d-40fd-aec4-52d63fd45844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0371c2d52c13449da4ce66a67c988698'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:48.194552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d279a-f962-4736-881a-b9527196298c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:48.196181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f69d279a-f962-4736-881a-b9527196298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.212866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 820/1659] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:47 2022] DELETE /identity/v3/users/0371c2d52c13449da4ce66a67c988698 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:17:48.218079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:48.218480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:48.218866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:48.250205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:48.253390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.326185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:48.354845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d279a-f962-4736-881a-b9527196298c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:48.365054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 821/1660] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:48.386304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:48.387973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.413836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:48.525905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:48.526929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:48.527741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:48.528159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:48.531273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.553447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:48.557421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:48.565721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02b85-6fe5-46ca-b819-bc78b1be8103 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:48.574380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:48.575284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:48.575622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:48.575948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:48.580900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 840/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:48.605376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:48.613821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:48.630622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 822/1662] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:48.763419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:48.765048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.790686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898db80-58e2-4e97-8efb-ef7806b90040 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:48.802349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:48.803044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:48.803328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:48.803601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] PATH_INFO: `/v3/projects/5528671fcc4246698944e162d776cbb7` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:48.809214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5528671fcc4246698944e162d776cbb7)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:48.810267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: WARNING py.warnings [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 01 04:17:48.810267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: warnings.warn(msg) Oct 01 04:17:48.810267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: Oct 01 04:17:48.811489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:48.887114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:48.888747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:48.918584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493cadb-db66-431f-ae4a-cd23bc6f773d service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:48.951094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5528671fcc4246698944e162d776cbb7', 'request_id': 'req-a0730dea-f7aa-4080-9dd9-04a81faa1729'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:48.968015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5528671fcc4246698944e162d776cbb7', 'request_id': 'req-a0730dea-f7aa-4080-9dd9-04a81faa1729'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.001080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5528671fcc4246698944e162d776cbb7', 'request_id': 'req-a0730dea-f7aa-4080-9dd9-04a81faa1729'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.033065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] The token cache is being invalidate because project 5528671fcc4246698944e162d776cbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:49.033369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.035581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a0730dea-f7aa-4080-9dd9-04a81faa1729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.043372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 841/1663] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:48 2022] DELETE /identity/v3/projects/5528671fcc4246698944e162d776cbb7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:49.045725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0550-65f0-4097-9add-29d2174f6e38 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:49.045725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0550-65f0-4097-9add-29d2174f6e38 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:49.045725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0550-65f0-4097-9add-29d2174f6e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:49.095911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-defd0550-65f0-4097-9add-29d2174f6e38 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:49.099644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-defd0550-65f0-4097-9add-29d2174f6e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:49.154450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:49.155339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:49.155624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:49.160534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] PATH_INFO: `/v3/projects/4f39dde36a394773b81c59bec6ef3020` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:49.173648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f39dde36a394773b81c59bec6ef3020)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:49.180338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:49.278695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 842/1664] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:17:49.280633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:49.280927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:49.281206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:49.313845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f39dde36a394773b81c59bec6ef3020', 'request_id': 'req-5cbe68e5-a814-4c77-956c-65bf4af68503'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.331505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f39dde36a394773b81c59bec6ef3020', 'request_id': 'req-5cbe68e5-a814-4c77-956c-65bf4af68503'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.336678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:49.337773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:49.350216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f39dde36a394773b81c59bec6ef3020', 'request_id': 'req-5cbe68e5-a814-4c77-956c-65bf4af68503'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.377603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] The token cache is being invalidate because project 4f39dde36a394773b81c59bec6ef3020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:49.377909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.383339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.388988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 823/1665] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:48 2022] DELETE /identity/v3/projects/4f39dde36a394773b81c59bec6ef3020 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:17:49.389956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:49.396029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:49.436632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:49.448103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:49.498720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 843/1666] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:49.499996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:49.541432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe68e5-a814-4c77-956c-65bf4af68503 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:49.552420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:49.553426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:49.553928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:49.554417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] PATH_INFO: `/v3/users/b14240dc964f4475a475016453f5d232` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:49.556086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14240dc964f4475a475016453f5d232)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:49.565699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:49.566560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a585-77e2-4e48-abd1-4897735e434e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:49.586170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:49.587547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:49.587991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:49.588497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:49.589304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:49.589772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:49.591672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:49.634655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 844/1667] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:49.643071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:49.667410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010778b-b18d-46d0-ac78-43c7af801812 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:49.677828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:49.678507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:49.678774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:49.679996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:49.679996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:49.681590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14240dc964f4475a475016453f5d232'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.681918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:49.717310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14240dc964f4475a475016453f5d232'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.718084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14240dc964f4475a475016453f5d232'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.752806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14240dc964f4475a475016453f5d232'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.756037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14240dc964f4475a475016453f5d232'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:49.763111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 845/1668] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:49.767592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:49.777981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:49.800232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 824/1669] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:49 2022] DELETE /identity/v3/users/b14240dc964f4475a475016453f5d232 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:49.967072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2502be-42f7-4e4c-8bad-b44d203807eb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.102343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.103652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.104120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.104549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.105309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:50.109855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:50.266105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 846/1670] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:49 2022] POST /identity/v3/users => generated 289 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:50.270867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:50.286006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff640c-5ee3-45bd-8066-61a9193ae4f4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.298203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.300679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.300679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.300679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.300679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:50.307185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:50.333568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 825/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:50.335149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:50.355589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a0f07-04a3-4a79-b440-2414cfc93a56 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.374818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.375723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.376575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.376851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.377820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:50.379479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:50.429641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 847/1672] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:17:50.433898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:50.447175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85094ee4-6fcf-4d84-9766-dca7e506eddf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.461563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b168e1d-6aef-4c6f-8518-7803a34a02b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.461563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b168e1d-6aef-4c6f-8518-7803a34a02b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.461563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b168e1d-6aef-4c6f-8518-7803a34a02b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.461563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b168e1d-6aef-4c6f-8518-7803a34a02b4 admin admin] PATH_INFO: `/v3/projects/6203580aa2554407ae9c9ad55b6da8e4/users/8dd6694478264be6a134b2dfd8f4ab30/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.463904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:50.470931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:50.494673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750265-35af-4d94-8f59-d7e654403d4d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.498517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b168e1d-6aef-4c6f-8518-7803a34a02b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6203580aa2554407ae9c9ad55b6da8e4, user_id=8dd6694478264be6a134b2dfd8f4ab30, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:50.503607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b168e1d-6aef-4c6f-8518-7803a34a02b4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:50.536955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.537925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.538409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.539001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] PATH_INFO: `/v3/projects/c0476df6a9b44cc99c238fb9cee270c5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.542004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0476df6a9b44cc99c238fb9cee270c5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:50.544387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 826/1673] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:50 2022] PUT /identity/v3/projects/6203580aa2554407ae9c9ad55b6da8e4/users/8dd6694478264be6a134b2dfd8f4ab30/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:50.545841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:50.555911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.556582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.556864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.641087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:50.642850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] MFA Rules not processed for user `8dd6694478264be6a134b2dfd8f4ab30`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:50.646304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:50.662878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0476df6a9b44cc99c238fb9cee270c5', 'request_id': 'req-d149a3d2-1585-44e5-91b9-19b7c676bae6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:50.701219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0476df6a9b44cc99c238fb9cee270c5', 'request_id': 'req-d149a3d2-1585-44e5-91b9-19b7c676bae6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:50.718529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0476df6a9b44cc99c238fb9cee270c5', 'request_id': 'req-d149a3d2-1585-44e5-91b9-19b7c676bae6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:50.742601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] The token cache is being invalidate because project c0476df6a9b44cc99c238fb9cee270c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:50.743396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:50.746911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:50.750422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 848/1674] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:50 2022] DELETE /identity/v3/projects/c0476df6a9b44cc99c238fb9cee270c5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:50.754671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:50.758704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:50.814865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:50.857691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 827/1675] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:17:50.859254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:50.860956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:50.898368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149a3d2-1585-44e5-91b9-19b7c676bae6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.919228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.921912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.922300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.923204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] PATH_INFO: `/v3/users/0604bfceb95a4a5daf53e4bf2b16f8e5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.925619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0604bfceb95a4a5daf53e4bf2b16f8e5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:50.932616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:50.974426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272b66-239d-41ff-b930-257d329f38f6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:50.986825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:50.987463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:50.988789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:50.990177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:50.992123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:51.013887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:51.103985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 828/1676] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:50 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:51.104158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0604bfceb95a4a5daf53e4bf2b16f8e5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.104894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0604bfceb95a4a5daf53e4bf2b16f8e5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.107565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.113263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:51.138166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0604bfceb95a4a5daf53e4bf2b16f8e5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.139053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0604bfceb95a4a5daf53e4bf2b16f8e5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.158596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0604bfceb95a4a5daf53e4bf2b16f8e5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.224545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 849/1677] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:50 2022] DELETE /identity/v3/users/0604bfceb95a4a5daf53e4bf2b16f8e5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:51.225101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.230558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:51.259495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e9229-d6b3-4f46-a3c9-b5426a26edc3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:51.366695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:51.395915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:51.396722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:51.397014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:51.397396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] PATH_INFO: `/v3/projects/2be3aa2d49364ee7b227a587b452d449` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:51.401950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be3aa2d49364ee7b227a587b452d449)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:51.413418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:51.427687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9515bc-080e-4a76-8b1d-e81ef506a138 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:51.441457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:51.442285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:51.442665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:51.443030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:51.443780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:51.447411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:51.501258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 850/1678] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:51 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:51.502377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.533638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:51.535468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d26bd-61e2-44a6-9057-4ea6420be0ee admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:51.584843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be3aa2d49364ee7b227a587b452d449', 'request_id': 'req-ee909540-c25f-46a8-8816-75793f4a9029'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.609756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be3aa2d49364ee7b227a587b452d449', 'request_id': 'req-ee909540-c25f-46a8-8816-75793f4a9029'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.639017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be3aa2d49364ee7b227a587b452d449', 'request_id': 'req-ee909540-c25f-46a8-8816-75793f4a9029'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.665241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] The token cache is being invalidate because project 2be3aa2d49364ee7b227a587b452d449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:51.665779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.666916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.668783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 829/1679] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:51 2022] DELETE /identity/v3/projects/2be3aa2d49364ee7b227a587b452d449 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:51.682907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.684911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:51.705167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:51.706068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:51.706439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:51.706803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:51.708867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:51.710592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:51.729193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee909540-c25f-46a8-8816-75793f4a9029 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:51.749491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:51.750592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:51.750954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:51.751235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] PATH_INFO: `/v3/users/daf9b7c1cd944ffda61e23aade3fa3f7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:51.752560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 851/1680] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:51.752670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf9b7c1cd944ffda61e23aade3fa3f7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:51.758579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:51.767257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.780224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:51.836432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef73c-04b2-49a7-bfbb-1797c653f781 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:51.854168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:51.854978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:51.855323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:51.855665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] PATH_INFO: `/v3/projects/291164e2ea8b404ca2b904e7e87fa648/users/2f5b08a0a944419f94c4e09c44c13413/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:51.879484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291164e2ea8b404ca2b904e7e87fa648, user_id=2f5b08a0a944419f94c4e09c44c13413, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:51.881341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf9b7c1cd944ffda61e23aade3fa3f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.882736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:51.906274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf9b7c1cd944ffda61e23aade3fa3f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.907815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 852/1681] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:51 2022] PUT /identity/v3/projects/291164e2ea8b404ca2b904e7e87fa648/users/2f5b08a0a944419f94c4e09c44c13413/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:51.908441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf9b7c1cd944ffda61e23aade3fa3f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.909472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.911585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:51.920747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf9b7c1cd944ffda61e23aade3fa3f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.921105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf9b7c1cd944ffda61e23aade3fa3f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:51.949158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 830/1682] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:51 2022] DELETE /identity/v3/users/daf9b7c1cd944ffda61e23aade3fa3f7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:17:51.952288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:51.953689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:52.001409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ace0c-9c21-4ab1-8371-b97b6dd3fac0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:52.083266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6fa80-2c0b-448f-b4e4-7052ef7e22f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:52.088569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:52.089577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.089577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.089859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.090446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:52.092560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:52.107707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 831/1683] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:52.112838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:52.132727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5e6c-99c5-4bc0-94cc-20a3820e3989 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:52.145332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:52.159866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb896c5-7c63-4677-842c-ac845450eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:52.162357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb896c5-7c63-4677-842c-ac845450eb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.163045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb896c5-7c63-4677-842c-ac845450eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.164493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb896c5-7c63-4677-842c-ac845450eb6a admin admin] PATH_INFO: `/v3/projects/291164e2ea8b404ca2b904e7e87fa648/users/2f5b08a0a944419f94c4e09c44c13413/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.168530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb896c5-7c63-4677-842c-ac845450eb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=291164e2ea8b404ca2b904e7e87fa648, user_id=2f5b08a0a944419f94c4e09c44c13413, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:52.172701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb896c5-7c63-4677-842c-ac845450eb6a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:52.179188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:52.181251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.183239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.183542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] PATH_INFO: `/v3/users/a8283e0d06ed4bf7914f2f191291b7c7` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.186431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8283e0d06ed4bf7914f2f191291b7c7)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:52.190627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 832/1684] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:52 2022] PUT /identity/v3/projects/291164e2ea8b404ca2b904e7e87fa648/users/2f5b08a0a944419f94c4e09c44c13413/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:17:52.190768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:52.204886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.205510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.206031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.273648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:52.310750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] MFA Rules not processed for user `2f5b08a0a944419f94c4e09c44c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:52.319333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:52.352135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8283e0d06ed4bf7914f2f191291b7c7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:52.352974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8283e0d06ed4bf7914f2f191291b7c7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:52.374898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8283e0d06ed4bf7914f2f191291b7c7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:52.377482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8283e0d06ed4bf7914f2f191291b7c7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:52.397467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c6b57c87-8415-40ea-80a6-42e525cdc943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8283e0d06ed4bf7914f2f191291b7c7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:52.459807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 853/1685] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:17:51 2022] DELETE /identity/v3/users/a8283e0d06ed4bf7914f2f191291b7c7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:52.461696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.462137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.462423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.507229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:52.508730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:52.542144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 833/1686] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:52.551034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:52.553372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:52.756610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 854/1687] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:52.760424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:52.765358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:52.776657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a11ca-4423-4178-9aab-5cbdd8e3aea7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:52.807763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a68ce-a004-4544-a851-0eb8c089757f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:52.821113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:52.827419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.827419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.827419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] PATH_INFO: `/v3/projects/2c680858f2da4758a0bb9d00e701febe` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.830618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c680858f2da4758a0bb9d00e701febe)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:52.833615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:52.946429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:52.958776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:52.961294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:52.961587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:52.967368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.000305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c680858f2da4758a0bb9d00e701febe', 'request_id': 'req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.029271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c680858f2da4758a0bb9d00e701febe', 'request_id': 'req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.053235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c680858f2da4758a0bb9d00e701febe', 'request_id': 'req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.056641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:53.084188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] The token cache is being invalidate because project 2c680858f2da4758a0bb9d00e701febe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:53.084492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.087049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.090923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 855/1688] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:52 2022] DELETE /identity/v3/projects/2c680858f2da4758a0bb9d00e701febe => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:53.102335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:53.106417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.158614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:53.161704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:53.193476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 834/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:17:53.198726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:53.205396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.241092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc534e-5aa1-4f0c-9387-916abc9b42ad service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:53.254431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:53.269733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6fa7-71c4-4025-b7e7-38dd0d407394 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:53.280030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:53.283432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.283790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.285040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.290864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.402445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:53.404272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.404560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.404842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] PATH_INFO: `/v3/projects/ea3fdf4d50594ec3b24320da779f2556` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.407417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3fdf4d50594ec3b24320da779f2556)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:53.412063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:53.458203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:53.460283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b183b5-5182-45c6-892f-e66da20437d7 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:53.491143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 856/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:53.498346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab08f4e-a8e4-4ac3-a849-83dab561a112 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.505951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab08f4e-a8e4-4ac3-a849-83dab561a112 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.506265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab08f4e-a8e4-4ac3-a849-83dab561a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.545122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3fdf4d50594ec3b24320da779f2556', 'request_id': 'req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.559032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fab08f4e-a8e4-4ac3-a849-83dab561a112 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:53.561879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3fdf4d50594ec3b24320da779f2556', 'request_id': 'req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.566672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fab08f4e-a8e4-4ac3-a849-83dab561a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.593090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3fdf4d50594ec3b24320da779f2556', 'request_id': 'req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.615578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] The token cache is being invalidate because project ea3fdf4d50594ec3b24320da779f2556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:53.615852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.618889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-297209a2-5e03-4c2b-ba0b-9a12b8409dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:53.626846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 835/1691] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:53 2022] DELETE /identity/v3/projects/ea3fdf4d50594ec3b24320da779f2556 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:53.629100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c5bb-31ed-48fb-a27b-57f944939a44 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.629466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c5bb-31ed-48fb-a27b-57f944939a44 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.629818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c5bb-31ed-48fb-a27b-57f944939a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.681754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78a4c5bb-31ed-48fb-a27b-57f944939a44 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:53.686295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78a4c5bb-31ed-48fb-a27b-57f944939a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.747037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 857/1692] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:53.749729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.750022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.750297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.801481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:53.809764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.845356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 858/1693] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:53.847475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:53.869598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 836/1694] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:53.877754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.878075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.878352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.886587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49a37-d5b8-4f88-8851-5d3726c11b00 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:53.897709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:53.898349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.900237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.900550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.901231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:53.901648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:53.907761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:53.936314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:53.936314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:53.946284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 859/1695] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:53.950322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:53.956026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 837/1696] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:17:53.959860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:53.970133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57a22-e355-427a-9267-ffc68ebeeb53 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:53.972815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e14e16-dfe2-48fb-8edb-705d8586cd43 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:53.977848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:53.978673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.979065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.979440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.980242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:53.980644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:53.986134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:53.991783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:53.992528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:53.993210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:53.993210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:53.993912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:53.997602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.000753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 838/1697] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:54.004686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.027160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d558b9c-1a6b-401a-9cdc-b0b9bfd7c57f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.035022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.035841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.036259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.036737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.037530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.039609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.060016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:54.076619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 860/1698] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:54.076968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:54.078565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.088760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 839/1699] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:54 2022] POST /identity/v3/projects => generated 357 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:54.093981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.195053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ab2db-f40a-4bb2-9832-64f49750d880 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.202548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.203279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.205086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.205496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.207134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.210122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.232341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ef96-aa32-4614-90de-1ea69b3f32f6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.242929 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 840/1700] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:54 2022] POST /identity/v3/users => generated 279 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:54.248251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.251197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.253297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.254436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.254919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.255825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.258227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.262765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ca2cc-fbc7-4ade-8921-4fe41e8a5a9c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.275833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.277657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.277948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.279173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.279849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.289534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.319039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 841/1701] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:54.324053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.326276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 861/1702] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:54 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:54.327211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.344097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ee022-4e76-4aa6-97b2-f86ddadd8531 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.350069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb5117-a1d1-4947-af71-f08dd592b36b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.351571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.352309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.352654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.353002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.353725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.355411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.361453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.362686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.362952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.363223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.364068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.366192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.371638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 862/1703] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:17:54.373015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.384645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e257b-1fe9-4ebb-b424-c2fde1c74864 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.390702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.391788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.392178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.392532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.393290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.394962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.400716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 842/1704] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:54.404870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.426281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b2bad-cba0-4fd8-aa0a-a7f0509a2f5e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.427507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 863/1705] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:54.429130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.439179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fa700-a7fc-4859-81e8-c043fcbcc276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.439885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa700-a7fc-4859-81e8-c043fcbcc276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.440230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa700-a7fc-4859-81e8-c043fcbcc276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.440489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa700-a7fc-4859-81e8-c043fcbcc276 admin admin] PATH_INFO: `/v3/projects/1e1f5272741e46af880ee8e49b6b449c/users/0d47865e7d8c4a198ab140d1ba7017d7/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.448665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b00a4-8bd7-4a40-9aeb-e9b5ab113cb7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.463774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78178876-9898-4551-9d46-0df557bfedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.465006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78178876-9898-4551-9d46-0df557bfedae admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.465433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78178876-9898-4551-9d46-0df557bfedae admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.469129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fa700-a7fc-4859-81e8-c043fcbcc276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1f5272741e46af880ee8e49b6b449c, user_id=0d47865e7d8c4a198ab140d1ba7017d7, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.469870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78178876-9898-4551-9d46-0df557bfedae admin admin] PATH_INFO: `/v3/projects/790a1b2e39704167ba3e0ed8c9f28290/users/095de7205b514f0492e358a9f0649342/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.474065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fa700-a7fc-4859-81e8-c043fcbcc276 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.497268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78178876-9898-4551-9d46-0df557bfedae admin admin] RBAC: Authorizing `identity:create_grant(project_id=790a1b2e39704167ba3e0ed8c9f28290, user_id=095de7205b514f0492e358a9f0649342, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.503536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78178876-9898-4551-9d46-0df557bfedae admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.523144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 843/1706] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:54 2022] PUT /identity/v3/projects/1e1f5272741e46af880ee8e49b6b449c/users/0d47865e7d8c4a198ab140d1ba7017d7/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:17:54.529041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 864/1707] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:54 2022] PUT /identity/v3/projects/790a1b2e39704167ba3e0ed8c9f28290/users/095de7205b514f0492e358a9f0649342/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:54.536907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.538232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.538699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.539136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.540770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.541159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.589189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:54.590911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:54.618564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] MFA Rules not processed for user `0d47865e7d8c4a198ab140d1ba7017d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:54.620007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:54.756938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 865/1708] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:17:54.756938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.758962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:54.774151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f8e1d-6ce4-45d7-9cd2-f2f528a1ad51 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:54.783418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:54.797942 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:54.798259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:54.798611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] PATH_INFO: `/v3/projects/bfd1145641d04e0f871dad1902d62cdc` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:54.801671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd1145641d04e0f871dad1902d62cdc)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:54.804312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:54.815151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 844/1709] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:54.815151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:54.815502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:54.930970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:54.941647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:54.982541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd1145641d04e0f871dad1902d62cdc', 'request_id': 'req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.010040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd1145641d04e0f871dad1902d62cdc', 'request_id': 'req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.010200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79aed5-8790-4748-9841-35cf90c0fd3c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:55.024084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd1145641d04e0f871dad1902d62cdc', 'request_id': 'req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.077174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] The token cache is being invalidate because project bfd1145641d04e0f871dad1902d62cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:55.078143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.079922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.081866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 866/1710] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:54 2022] DELETE /identity/v3/projects/bfd1145641d04e0f871dad1902d62cdc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:55.082849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:55.085573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.146273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:55.147284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.147573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.147850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.153238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.186111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee87c8-aa80-44a6-ae4f-9cb9a66d6eb5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:55.192325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9fde1-1754-4a8a-8ba1-fefb3cf1d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:55.193054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9fde1-1754-4a8a-8ba1-fefb3cf1d1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.193431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9fde1-1754-4a8a-8ba1-fefb3cf1d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.193776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9fde1-1754-4a8a-8ba1-fefb3cf1d1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.194497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9fde1-1754-4a8a-8ba1-fefb3cf1d1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:55.196841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9fde1-1754-4a8a-8ba1-fefb3cf1d1f9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:55.245100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 867/1711] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:55 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:55.245100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.245100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.245100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.284420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] MFA Rules not processed for user `5ac2c0f2fcb349c68604724730d274df`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:55.286397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.307618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:55.311275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615959d-d909-47bc-9e9d-9fdd4421f83f service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:55.342397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 845/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:55.344124 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.345060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.345424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.378106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:55.380007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.469872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 868/1713] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:55.478418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:55.478418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.533494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 846/1714] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:55.535226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:55.579989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0a254-09c1-4bd9-a773-53d14ba48ce8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:55.586034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:55.613845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:55.614557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.614944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.615280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.616086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:55.620161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:55.643716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5aa49-52d4-4236-b6a9-b56ec60a2f95 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:55.661617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:55.663743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.664102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.671065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 847/1715] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:55 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:55.671149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] PATH_INFO: `/v3/projects/30a7184818594203904e2d3762aac40f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.671246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:55.671349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a7184818594203904e2d3762aac40f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:55.671349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:55.671478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.744785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:55.765616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a7184818594203904e2d3762aac40f', 'request_id': 'req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.783468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a7184818594203904e2d3762aac40f', 'request_id': 'req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.790932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a7184818594203904e2d3762aac40f', 'request_id': 'req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.807307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] The token cache is being invalidate because project 30a7184818594203904e2d3762aac40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:17:55.807533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.808548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bdd3cb46-5dd3-43d5-a0ed-a020d379e956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:17:55.813713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 869/1716] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:17:55 2022] DELETE /identity/v3/projects/30a7184818594203904e2d3762aac40f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:55.813713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:55.813713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:55.813713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:55.858721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:55.862676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:55.864531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e8e4-6a81-4dad-ba34-02ee61be7e66 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:55.995480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 870/1717] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:55.996675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.000201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:56.044428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8691b2b-2873-49f0-b6e6-7428845a9d85 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.055542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b354d5-8d33-4322-a7b6-7231f668dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.056067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.056769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.057341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b354d5-8d33-4322-a7b6-7231f668dc5a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.057613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b354d5-8d33-4322-a7b6-7231f668dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.057877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b354d5-8d33-4322-a7b6-7231f668dc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.058388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.058670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.059341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b354d5-8d33-4322-a7b6-7231f668dc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.061831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b354d5-8d33-4322-a7b6-7231f668dc5a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.063732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:56.090959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 871/1718] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:56.090959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.090959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.091418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.141943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:56.145804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:56.166214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 872/1719] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:56.169466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.192424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e27c-cd78-46d6-b1dc-526138d93759 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.204739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.205594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.206975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.207249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.208159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:56.208468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.210646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.212397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.214674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c096f3-da34-43c2-8601-b9931dd3cd45 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.232798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 848/1720] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:56.233652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.243927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 873/1721] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:56.247067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.247288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.247560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.258896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f77b-3b3e-42c7-b137-e715fcc2a08e service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.275659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.276581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.276853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.277128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] PATH_INFO: `/v3/projects/96966d0c17044762956ffbf0c46f2bf3/users/1c5a36ab3e2b4421b90f583d1af9a153/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.297997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:56.301305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:56.320230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96966d0c17044762956ffbf0c46f2bf3, user_id=1c5a36ab3e2b4421b90f583d1af9a153, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.326463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.330182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 874/1722] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:56.330890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.362556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 849/1723] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:56 2022] PUT /identity/v3/projects/96966d0c17044762956ffbf0c46f2bf3/users/1c5a36ab3e2b4421b90f583d1af9a153/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:56.362556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.362952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d00c-ad3e-4f82-883c-305dc713b147 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.446034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:56.460722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:56.501797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5529d8-3ad0-494e-a828-bef827a35070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.502459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5529d8-3ad0-494e-a828-bef827a35070 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.502856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5529d8-3ad0-494e-a828-bef827a35070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.503303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5529d8-3ad0-494e-a828-bef827a35070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.504342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5529d8-3ad0-494e-a828-bef827a35070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.506734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5529d8-3ad0-494e-a828-bef827a35070 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.523312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1013ff4-f6db-4712-9eaa-c0e237cbfd17 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.524693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.525303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.525750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.526032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.526788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:17:56.527099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.528805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.543899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 850/1724] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:17:56.548436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.565321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2654-71a8-4978-9bfd-484377941f3d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.570601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.571368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.571660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.572075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.572868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.574568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 875/1725] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:56 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:56.575090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.577057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.578877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.580150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.593638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 851/1726] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:56.596090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.611506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc99c2d-3524-43d2-b1c8-d86c9f05e803 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.658737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] MFA Rules not processed for user `095de7205b514f0492e358a9f0649342`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:56.660067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:56.693536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.694465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.694821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.695606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.696881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.700202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.755573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 852/1727] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:56 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:56.757833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.842342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 876/1728] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:56.842342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.870572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f42d2-d25e-47f6-895a-6ae62114484e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.900142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297ab70-7237-45f2-a2fe-01634226145f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:56.915557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:56.916488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:56.916797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:56.917042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:56.917694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:56.922892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:56.966695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 853/1729] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:56 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:56.968939 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:56.980920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:57.027286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.028018 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.028306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.028588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] PATH_INFO: `/v3/projects/96966d0c17044762956ffbf0c46f2bf3/users/1c5a36ab3e2b4421b90f583d1af9a153/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.037628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96966d0c17044762956ffbf0c46f2bf3, user_id=1c5a36ab3e2b4421b90f583d1af9a153, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.040907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.051827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:57.077883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 877/1730] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:56 2022] PUT /identity/v3/projects/96966d0c17044762956ffbf0c46f2bf3/users/1c5a36ab3e2b4421b90f583d1af9a153/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:57.079060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.110957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea14cd4-a326-40b5-b2a2-b0e56aa05cc9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.199402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:57.235721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.236412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.238861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.239139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.242728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c505b-be48-44c0-9127-87c866312d66 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.246308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:57.256266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.258470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.259560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.260043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.262740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.270337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.322015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 878/1731] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:57 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:57.323706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.329694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:57.364840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358ac8f-acd2-40d9-91f5-10964aafcd4b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.383664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf67bb8-0a29-4f03-9606-721072c280d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.384685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf67bb8-0a29-4f03-9606-721072c280d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.385918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf67bb8-0a29-4f03-9606-721072c280d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.387727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf67bb8-0a29-4f03-9606-721072c280d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.399189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.400960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.405884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf67bb8-0a29-4f03-9606-721072c280d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.408277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf67bb8-0a29-4f03-9606-721072c280d1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.429985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 854/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:57.439875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.465100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815e83-8880-4c24-9ee3-1be66a1d7c2b service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.473997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.475790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.476777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.477122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.478880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.481708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.490246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 879/1733] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:57 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:57.491744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.492291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.493024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.521819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 855/1734] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:57.521819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.563962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e85d17-27da-4c72-a81f-95c8a4c1bf74 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.569634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] MFA Rules not processed for user `1c5a36ab3e2b4421b90f583d1af9a153`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:57.572277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:57.718890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.719524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.719524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.720077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.720708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.722361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.756269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 856/1735] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:57.757323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.803044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebd8ae-b349-4c99-b291-c5c8305c8ce5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.816684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.819181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.819469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.819747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.820430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.820943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 880/1736] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:57.822024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.824742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.849479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5bddf-4a9a-4cf1-a332-d78ff30e07c3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.862613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.864607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.867272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.867920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.868976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.870859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.878136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 857/1737] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:57 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:57.879213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.885459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:57.892055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544b87c-71ad-427b-9d36-7185f8081f08 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.901125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.901656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.901871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 881/1738] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:57.902098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.902532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.903246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.903357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.906272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:57.940272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 858/1739] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:57.941441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:57.962979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518d7c9-dbe9-40b4-a2b0-11e7630a4c78 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:57.974424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:57.975060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:57.975619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:57.975903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:57.976676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:57.982019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.006286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 859/1740] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:58.007233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.032852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf0ec7-0a0b-4bc6-b023-8896ca34a92c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.038510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724f7e0-c4dd-405c-8a30-25a8a6504107 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.043099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.045734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.046043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.046427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] PATH_INFO: `/v3/projects/cd01d1b049144022ac22f96339df0ff3/users/b46a13b8f6e54ce4b510173f1fe41005/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.051079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.051985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.052408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.052830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.078329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.080139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.085452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd01d1b049144022ac22f96339df0ff3, user_id=b46a13b8f6e54ce4b510173f1fe41005, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.089309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.104506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 882/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:58.105573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.116665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 860/1742] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:58 2022] PUT /identity/v3/projects/cd01d1b049144022ac22f96339df0ff3/users/b46a13b8f6e54ce4b510173f1fe41005/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:58.117635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.129984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2be26-a3dd-4d53-82a6-75aaa92f9f1c service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.197654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:58.214390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7f905-20ac-4105-bae1-2f213554d089 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.224673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a978e-2379-4951-9bde-d3af3b33a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.225714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a978e-2379-4951-9bde-d3af3b33a40d admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.226280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a978e-2379-4951-9bde-d3af3b33a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.226717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a978e-2379-4951-9bde-d3af3b33a40d admin admin] PATH_INFO: `/v3/projects/0e8c5e5a0d8444809a642759d5085172/users/b0b2f8748a8d4d9486c73a932462c332/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.254768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a978e-2379-4951-9bde-d3af3b33a40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8c5e5a0d8444809a642759d5085172, user_id=b0b2f8748a8d4d9486c73a932462c332, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.260216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a978e-2379-4951-9bde-d3af3b33a40d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.266959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.268228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.268228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.268543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] PATH_INFO: `/v3/projects/b17fe18c213643a0b820d5595264e664/users/7dc62741d8fa40ae85d477c8e6888348/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.282914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 861/1743] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:58 2022] PUT /identity/v3/projects/0e8c5e5a0d8444809a642759d5085172/users/b0b2f8748a8d4d9486c73a932462c332/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:58.284479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.285037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.285676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.322996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17fe18c213643a0b820d5595264e664, user_id=7dc62741d8fa40ae85d477c8e6888348, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.329977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.338160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] MFA Rules not processed for user `b46a13b8f6e54ce4b510173f1fe41005`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:58.339801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:58.354973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 883/1744] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:58 2022] PUT /identity/v3/projects/b17fe18c213643a0b820d5595264e664/users/7dc62741d8fa40ae85d477c8e6888348/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:58.365386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.455830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 862/1745] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:58.457154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.499550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:58.512390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feaaec-e2f2-4a56-a3ce-5c64803a997b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.524742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b412d-43a0-48fd-b4cd-4c56bb906ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.525375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b412d-43a0-48fd-b4cd-4c56bb906ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.525653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b412d-43a0-48fd-b4cd-4c56bb906ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.525922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b412d-43a0-48fd-b4cd-4c56bb906ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.526574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b412d-43a0-48fd-b4cd-4c56bb906ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.528199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b412d-43a0-48fd-b4cd-4c56bb906ae1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.549327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1dbea-4a29-4545-b858-cb4b6765e327 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.555006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 884/1746] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:58.559307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.559617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.560504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.624431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.625600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.625890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.626241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.628844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:58.678566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] MFA Rules not processed for user `7dc62741d8fa40ae85d477c8e6888348`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:17:58.680959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:17:58.754774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.756556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.775286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 863/1747] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:17:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:17:58.776269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.806744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285ec6-8fbd-41a3-870e-51b153ab0fc7 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:58.822418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:58.824033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:58.824033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:58.824033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:58.824867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:58.828968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:58.902959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 885/1748] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:17:58.903905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.909680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 864/1749] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:58 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:58.910084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:58.947391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d6404-0f6d-43fa-821f-47602bc8d977 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.031330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:59.078506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95663-f5f6-4e7e-913e-32cee5df5129 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.086546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.087244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.087477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.087768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.088900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.091864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.104139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.109015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.112147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.114096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] PATH_INFO: `/v3/projects/0e8c5e5a0d8444809a642759d5085172/users/b0b2f8748a8d4d9486c73a932462c332/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.128669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8c5e5a0d8444809a642759d5085172, user_id=b0b2f8748a8d4d9486c73a932462c332, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.143005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.158590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 865/1750] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:17:58 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:59.158590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.170690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:59.185611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 886/1751] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:58 2022] PUT /identity/v3/projects/0e8c5e5a0d8444809a642759d5085172/users/b0b2f8748a8d4d9486c73a932462c332/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:59.188743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.288793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059108-8d99-4302-9d6e-4c6db5841180 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.298130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.299393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.299919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.300613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.301508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.305498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.333792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8879d6-19e5-4e8f-b9b4-eb15fb89b412 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.343596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 887/1752] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:59 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:59.345699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.354894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.355587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.355873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.356329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.357175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.359204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.362943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ecd62-bb9e-440f-aa8c-55d5e327af45 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.375975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.376874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.377162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.377436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.380714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.382948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.410387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 888/1753] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:59.411996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.433544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0408f2-6c4a-41ca-9284-52d8da91a1fb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.435303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 866/1754] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:17:59 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:17:59.436726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.440593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.441871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.442296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.443565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] PATH_INFO: `/v3/projects/04c170e97f494d66a3bcf07350a73ec1/users/93a5c99d6eb2455993560a77b1fdaa3c/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.470822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddcd5-d468-477d-b12c-3933ae46ef63 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.474761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c170e97f494d66a3bcf07350a73ec1, user_id=93a5c99d6eb2455993560a77b1fdaa3c, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.478559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.500212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.502180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.503668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.504237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.505589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.526849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 889/1755] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:59 2022] PUT /identity/v3/projects/04c170e97f494d66a3bcf07350a73ec1/users/93a5c99d6eb2455993560a77b1fdaa3c/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:59.527200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.535378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.580510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 867/1756] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:59.582857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.613642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609f35-44a3-4983-a5f4-0625e18a850a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.790540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b72df5-35a0-4def-b752-be260660d53f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.816306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.817031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.817231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.817497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.831531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.837918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.885483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 890/1757] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:17:59.887518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:17:59.908146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.909383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.911794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.912623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] PATH_INFO: `/v3/projects/cf6a690dca8a4f74b88abbfa1cb00af0/users/3fd3dc231aec45aea928257af6588956/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.914418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3d1ab-2eb9-482d-986a-5bb3ea80343e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:17:59.926477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc52dc-bab2-4c29-829a-bcce134c1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:17:59.927169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc52dc-bab2-4c29-829a-bcce134c1386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.927447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc52dc-bab2-4c29-829a-bcce134c1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.927718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc52dc-bab2-4c29-829a-bcce134c1386 admin admin] PATH_INFO: `/v3/projects/04c170e97f494d66a3bcf07350a73ec1/users/93a5c99d6eb2455993560a77b1fdaa3c/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.932543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc52dc-bab2-4c29-829a-bcce134c1386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c170e97f494d66a3bcf07350a73ec1, user_id=93a5c99d6eb2455993560a77b1fdaa3c, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.939999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc52dc-bab2-4c29-829a-bcce134c1386 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:17:59.977281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 891/1758] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:59 2022] PUT /identity/v3/projects/04c170e97f494d66a3bcf07350a73ec1/users/93a5c99d6eb2455993560a77b1fdaa3c/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:17:59.979879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6a690dca8a4f74b88abbfa1cb00af0, user_id=3fd3dc231aec45aea928257af6588956, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:17:59.981056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:17:59.981343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:17:59.981626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:17:59.983410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:00.016595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:00.019391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 868/1759] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:17:59 2022] PUT /identity/v3/projects/cf6a690dca8a4f74b88abbfa1cb00af0/users/3fd3dc231aec45aea928257af6588956/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:00.024177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:00.029948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] MFA Rules not processed for user `93a5c99d6eb2455993560a77b1fdaa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:00.034941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:00.213853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 892/1760] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:17:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:00.228487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:00.229885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:00.251945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00648f-bf4a-46e1-8115-c3459cfb5279 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:00.283177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:00.283817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:00.284130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:00.284405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:00.285313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:00.286687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:00.298515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:00.311356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 869/1761] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:00.314580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:00.338559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3cd29-f4e6-401e-bc39-76c929aa5b6c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:00.365319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795a272-7bf7-409d-9072-8f06c74378e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:00.366026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795a272-7bf7-409d-9072-8f06c74378e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:00.366311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795a272-7bf7-409d-9072-8f06c74378e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:00.366589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795a272-7bf7-409d-9072-8f06c74378e3 admin admin] PATH_INFO: `/v3/projects/cf6a690dca8a4f74b88abbfa1cb00af0/users/3fd3dc231aec45aea928257af6588956/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:00.368976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795a272-7bf7-409d-9072-8f06c74378e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6a690dca8a4f74b88abbfa1cb00af0, user_id=3fd3dc231aec45aea928257af6588956, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:00.372499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795a272-7bf7-409d-9072-8f06c74378e3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:00.403482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 870/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:00 2022] PUT /identity/v3/projects/cf6a690dca8a4f74b88abbfa1cb00af0/users/3fd3dc231aec45aea928257af6588956/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:00.405458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85f696-51fd-4334-94db-56157db0db2a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:00.406146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85f696-51fd-4334-94db-56157db0db2a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:00.406146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85f696-51fd-4334-94db-56157db0db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:00.442670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b44713-c193-405f-8ea8-13904306d8b1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:00.489302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1d85f696-51fd-4334-94db-56157db0db2a None None] MFA Rules not processed for user `3fd3dc231aec45aea928257af6588956`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:00.492431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1d85f696-51fd-4334-94db-56157db0db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:00.609467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:00.610690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:00.610980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:00.611267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:00.730441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 871/1763] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:00.731688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:00.732001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:00.736575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:00.785012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:00.786480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:00.802391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:00.804048 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] MFA Rules not processed for user `5ac2c0f2fcb349c68604724730d274df`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:00.805414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:00.810357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 893/1764] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:00.811361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:00.822361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746917b5-e4cb-408b-92d9-290809c87006 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:00.832109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:00.834285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:00.834285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:00.834285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:00.848868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:00.850406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:00.879369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 894/1765] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:00.957804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 872/1766] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:01.071007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:01.088539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdc990-4696-4c01-82b6-61413c792687 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:01.096865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04728-6a9b-4750-966b-8922762cef97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:01.097807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04728-6a9b-4750-966b-8922762cef97 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:01.098286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04728-6a9b-4750-966b-8922762cef97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:01.098919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04728-6a9b-4750-966b-8922762cef97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:01.174863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:01.189130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a85096-22b2-492d-945c-740b52d4ed66 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:01.209836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c9e6-dbdd-4a20-8337-32429725c9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:01.210641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c9e6-dbdd-4a20-8337-32429725c9ad service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:01.211211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c9e6-dbdd-4a20-8337-32429725c9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:01.213230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c9e6-dbdd-4a20-8337-32429725c9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:01.285116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa04728-6a9b-4750-966b-8922762cef97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:01.286596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa04728-6a9b-4750-966b-8922762cef97 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:01.318445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 895/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:01.354317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c9e6-dbdd-4a20-8337-32429725c9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:01.355921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c9e6-dbdd-4a20-8337-32429725c9ad service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:01.366805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 873/1768] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:01.604962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:01.605371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:01.605936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:01.684993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] MFA Rules not processed for user `51129e120cd14371b995bcc451264981`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:01.686377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:01.871794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9362f5-bb3a-4fa4-a99b-18ae37f16ec9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:01.872162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9362f5-bb3a-4fa4-a99b-18ae37f16ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:01.872327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9362f5-bb3a-4fa4-a99b-18ae37f16ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:01.876352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 896/1769] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:01.900336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8a9362f5-bb3a-4fa4-a99b-18ae37f16ec9 None None] MFA Rules not processed for user `51129e120cd14371b995bcc451264981`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:01.901864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8a9362f5-bb3a-4fa4-a99b-18ae37f16ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:01.914986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 874/1770] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:01.923618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:01.925411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:02.088458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2187f8-6431-4edf-b63b-591d2a10aae7 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:02.104134 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b9496-3af0-45bc-a402-b77552a0f757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:02.105895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9496-3af0-45bc-a402-b77552a0f757 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:02.106692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9496-3af0-45bc-a402-b77552a0f757 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:02.107556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9496-3af0-45bc-a402-b77552a0f757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:02.131164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b9496-3af0-45bc-a402-b77552a0f757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:02.133082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b9496-3af0-45bc-a402-b77552a0f757 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:02.143010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:02.152771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 897/1771] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:02.205130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c3c0-83e7-4ced-b67d-50ef619d1ada None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:02.205781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c3c0-83e7-4ced-b67d-50ef619d1ada None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:02.206424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c3c0-83e7-4ced-b67d-50ef619d1ada None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:02.208374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 875/1772] 10.222.0.27 () {54 vars in 912 bytes} [Sat Oct 1 04:18:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:18:02.214892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c7d5-5bfc-4bff-8023-b0a0dc2ea4b9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:02.215251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c7d5-5bfc-4bff-8023-b0a0dc2ea4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:02.215638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138c7d5-5bfc-4bff-8023-b0a0dc2ea4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:02.311744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b138c7d5-5bfc-4bff-8023-b0a0dc2ea4b9 None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:02.313673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b138c7d5-5bfc-4bff-8023-b0a0dc2ea4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:02.463870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 898/1773] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:18:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:02.472512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c3c0-83e7-4ced-b67d-50ef619d1ada None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:02.475884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dbe5c3c0-83e7-4ced-b67d-50ef619d1ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:02.507503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c3c0-83e7-4ced-b67d-50ef619d1ada None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:02.512230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a053a80-078e-4c40-966c-c2cf7f3128a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:02.513141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a053a80-078e-4c40-966c-c2cf7f3128a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:02.513599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a053a80-078e-4c40-966c-c2cf7f3128a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:02.514482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a053a80-078e-4c40-966c-c2cf7f3128a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:02.529001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:02.536223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a053a80-078e-4c40-966c-c2cf7f3128a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:02.542900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a053a80-078e-4c40-966c-c2cf7f3128a0 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:02.571752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 876/1774] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:02.842409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9bfd-7c54-454d-a78e-82a6173a1ea4 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:02.843423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9bfd-7c54-454d-a78e-82a6173a1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:02.844531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9bfd-7c54-454d-a78e-82a6173a1ea4 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:02.846564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 899/1775] 10.222.0.27 () {54 vars in 912 bytes} [Sat Oct 1 04:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:18:02.853111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ea88-2691-4ba1-a39d-0b1b4f881297 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:02.854535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ea88-2691-4ba1-a39d-0b1b4f881297 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:02.854950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ea88-2691-4ba1-a39d-0b1b4f881297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:02.942395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0ab8ea88-2691-4ba1-a39d-0b1b4f881297 None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:02.951436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0ab8ea88-2691-4ba1-a39d-0b1b4f881297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:02.987451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 877/1776] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:18:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:03.109385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9bfd-7c54-454d-a78e-82a6173a1ea4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:03.137824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9bfd-7c54-454d-a78e-82a6173a1ea4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:03.149316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf42f30-9eda-4dff-8b2a-aa65930010a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:03.149964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42f30-9eda-4dff-8b2a-aa65930010a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:03.150244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42f30-9eda-4dff-8b2a-aa65930010a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:03.150516 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf42f30-9eda-4dff-8b2a-aa65930010a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:03.189912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf42f30-9eda-4dff-8b2a-aa65930010a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:03.196312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf42f30-9eda-4dff-8b2a-aa65930010a1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:03.239413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 900/1777] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:03.342861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547216e-c913-4f56-8980-bc8e9d3ee3bb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:03.343367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547216e-c913-4f56-8980-bc8e9d3ee3bb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:03.343458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547216e-c913-4f56-8980-bc8e9d3ee3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:03.391809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:03.392176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:03.392462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:03.460072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4547216e-c913-4f56-8980-bc8e9d3ee3bb None None] MFA Rules not processed for user `b0b2f8748a8d4d9486c73a932462c332`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:03.461824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4547216e-c913-4f56-8980-bc8e9d3ee3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:03.480451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] MFA Rules not processed for user `9e21985df0d94752864f7858ca71e05d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:03.482041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:03.608611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 878/1778] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:03.620987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbab75-d43e-4c4e-a414-7ebe2a56839b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:03.621673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbab75-d43e-4c4e-a414-7ebe2a56839b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:03.622141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbab75-d43e-4c4e-a414-7ebe2a56839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:03.701814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-35dbab75-d43e-4c4e-a414-7ebe2a56839b None None] MFA Rules not processed for user `095de7205b514f0492e358a9f0649342`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:03.709199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-35dbab75-d43e-4c4e-a414-7ebe2a56839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:03.872981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 901/1779] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:03.872981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:03.872981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:03.949674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 879/1780] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:03.951112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:03.951399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:03.951674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:04.057161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] MFA Rules not processed for user `9e21985df0d94752864f7858ca71e05d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:04.059889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:04.077158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 880/1781] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:04.079372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:04.085583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0e1fb-7c0e-4b0d-b906-d661497b3e03 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:04.086246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:04.102521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:04.104952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:04.105302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:04.105651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:04.110997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:04.134619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5520e-d825-4def-a591-c7589a8ee025 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:04.146737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:04.147743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528389ff-dd13-4dfa-8077-e859e49b27d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:04.148477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528389ff-dd13-4dfa-8077-e859e49b27d5 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:04.149829 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528389ff-dd13-4dfa-8077-e859e49b27d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:04.150002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:04.150083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528389ff-dd13-4dfa-8077-e859e49b27d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:04.179641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528389ff-dd13-4dfa-8077-e859e49b27d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:04.181460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528389ff-dd13-4dfa-8077-e859e49b27d5 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:04.200335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 902/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:04.204409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 881/1783] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:04.516347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:04.523586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:04.537156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78873f7-8c48-4d5c-a4fa-dc3356abda67 service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:04.554207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66533e97-d053-4167-b61e-af9007bbca68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:04.554856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66533e97-d053-4167-b61e-af9007bbca68 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:04.555448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66533e97-d053-4167-b61e-af9007bbca68 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:04.555765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66533e97-d053-4167-b61e-af9007bbca68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:04.579852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66533e97-d053-4167-b61e-af9007bbca68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:04.582437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66533e97-d053-4167-b61e-af9007bbca68 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:04.619682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 903/1784] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:06.561052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:06.563306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:06.563819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:06.648650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] MFA Rules not processed for user `51129e120cd14371b995bcc451264981`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:06.652280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:06.680404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 882/1785] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:09.127024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:09.127753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:09.127900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:09.299835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:09.301864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:09.548321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 904/1786] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:09.783801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:09.791653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:09.793655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:09.937293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:09.951284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39024f-239c-45b6-b9c3-570218b7f917 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:09.959505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:09.960397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:09.960803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:09.961302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] PATH_INFO: `/v3/users/b46a13b8f6e54ce4b510173f1fe41005` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:09.962687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46a13b8f6e54ce4b510173f1fe41005)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:09.965101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:10.080696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bed484-7b8d-4210-8eda-2747a43b193a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:10.094877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46a13b8f6e54ce4b510173f1fe41005'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:10.095497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96da7-c7d2-4937-97cd-8afe7f1bf3fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:10.096194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96da7-c7d2-4937-97cd-8afe7f1bf3fc service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:10.096598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96da7-c7d2-4937-97cd-8afe7f1bf3fc service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:10.096893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96da7-c7d2-4937-97cd-8afe7f1bf3fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:10.108460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46a13b8f6e54ce4b510173f1fe41005'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:10.108677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96da7-c7d2-4937-97cd-8afe7f1bf3fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:10.109687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46a13b8f6e54ce4b510173f1fe41005'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:10.110987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96da7-c7d2-4937-97cd-8afe7f1bf3fc service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:10.121373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 905/1787] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:18:10.135150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46a13b8f6e54ce4b510173f1fe41005'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:10.136920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46a13b8f6e54ce4b510173f1fe41005'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:10.190790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 883/1788] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:09 2022] DELETE /identity/v3/users/b46a13b8f6e54ce4b510173f1fe41005 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:10.195039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646c4d-64fa-4627-8a2f-2f1af56d86dc None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:10.195553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646c4d-64fa-4627-8a2f-2f1af56d86dc None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:10.195907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646c4d-64fa-4627-8a2f-2f1af56d86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:10.297156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4a646c4d-64fa-4627-8a2f-2f1af56d86dc None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:10.299330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4a646c4d-64fa-4627-8a2f-2f1af56d86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:10.415794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:10.568305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 906/1789] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:10.850568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:10.852127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:11.082854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd4fd5-1f31-472d-9a90-52318666672c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:11.116255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:11.116910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:11.117232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:11.117517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:11.188269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:11.193299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:11.229303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 884/1790] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:13.519306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:13.520199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:13.520841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:13.625076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:13.626321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:13.666946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 907/1791] 10.222.0.13 () {58 vars in 1015 bytes} [Sat Oct 1 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:13.739150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:13.762129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16acdb-c97e-4691-86b4-3d7621fa171d service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:13.772651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:13.776450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:13.777165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:13.777660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:13.796654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:13.799266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:13.837999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 885/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:14.035655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:14.037282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:14.068751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181f9d7-1e22-4c02-8874-a552dda56a17 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:14.079175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:14.079858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:14.080156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:14.080425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] PATH_INFO: `/v3/projects/cd01d1b049144022ac22f96339df0ff3` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:14.083797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd01d1b049144022ac22f96339df0ff3)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:14.085739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:14.206962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd01d1b049144022ac22f96339df0ff3', 'request_id': 'req-0fedf311-397a-4283-9e27-0509cfcf4d59'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.232693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd01d1b049144022ac22f96339df0ff3', 'request_id': 'req-0fedf311-397a-4283-9e27-0509cfcf4d59'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.250600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd01d1b049144022ac22f96339df0ff3', 'request_id': 'req-0fedf311-397a-4283-9e27-0509cfcf4d59'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.284095 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] The token cache is being invalidate because project cd01d1b049144022ac22f96339df0ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:14.289924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.292258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.303002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 908/1793] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:14 2022] DELETE /identity/v3/projects/cd01d1b049144022ac22f96339df0ff3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:14.305018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:14.335053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790066c3-8d1e-4165-8563-4a8d4de64a98 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:14.549122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:14.549869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:14.550188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:14.550466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] PATH_INFO: `/v3/users/3fd3dc231aec45aea928257af6588956` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:14.561363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd3dc231aec45aea928257af6588956)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:14.574457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:14.591261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:14.746627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd3dc231aec45aea928257af6588956'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.759572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd3dc231aec45aea928257af6588956'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.760655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd3dc231aec45aea928257af6588956'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.772330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd3dc231aec45aea928257af6588956'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.773833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-30f827ac-060c-4ba0-9bbe-9abe74ed1718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd3dc231aec45aea928257af6588956'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:14.812726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 886/1794] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:14 2022] DELETE /identity/v3/users/3fd3dc231aec45aea928257af6588956 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:16.319851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:16.321679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:16.352002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedf311-397a-4283-9e27-0509cfcf4d59 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:16.690593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:16.691294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:16.691585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:16.691860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] PATH_INFO: `/v3/projects/cf6a690dca8a4f74b88abbfa1cb00af0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:16.704433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6a690dca8a4f74b88abbfa1cb00af0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:16.717059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:16.925240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6a690dca8a4f74b88abbfa1cb00af0', 'request_id': 'req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:16.932093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:16.951441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6a690dca8a4f74b88abbfa1cb00af0', 'request_id': 'req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:16.972315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6a690dca8a4f74b88abbfa1cb00af0', 'request_id': 'req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.025430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] The token cache is being invalidate because project cf6a690dca8a4f74b88abbfa1cb00af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:17.028932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.036951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.041700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 909/1795] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:16 2022] DELETE /identity/v3/projects/cf6a690dca8a4f74b88abbfa1cb00af0 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:17.047909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6371de-1e78-4392-a71c-a290c511ce39 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:17.048478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6371de-1e78-4392-a71c-a290c511ce39 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:17.048671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6371de-1e78-4392-a71c-a290c511ce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:17.119585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ec6371de-1e78-4392-a71c-a290c511ce39 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:17.141126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ec6371de-1e78-4392-a71c-a290c511ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:17.144487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:17.145982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:17.384965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04265bcc-7cf9-4e28-bf8e-ace8ac3e5385 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:17.393770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 887/1796] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:17.402082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:17.402397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:17.402654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:17.405469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:17.406835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:17.407120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:17.407403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] PATH_INFO: `/v3/users/8dd6694478264be6a134b2dfd8f4ab30` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:17.419417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd6694478264be6a134b2dfd8f4ab30)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:17.426035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:17.457247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:17.462326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:17.499458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 888/1797] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:17.502435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:17.537015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035d7e-d3a0-4e23-8318-4a167605d00b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:17.550132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:17.550780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:17.551059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:17.551333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:17.552542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:17.553049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:17.559079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:17.573127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd6694478264be6a134b2dfd8f4ab30'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.573855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd6694478264be6a134b2dfd8f4ab30'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.601288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 889/1798] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:18:17.607076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:17.613352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd6694478264be6a134b2dfd8f4ab30'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.615094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd6694478264be6a134b2dfd8f4ab30'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.631173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aee25-2306-4353-9469-202c62293879 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:17.640775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:17.642161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:17.642161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:17.642395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:17.642922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c168d9da-123c-4de7-a471-c4d0e70606ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd6694478264be6a134b2dfd8f4ab30'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:17.643032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:17.645114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:17.720353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 890/1799] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:17 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:17.721538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:17.725583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:17.747972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 910/1800] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:17 2022] DELETE /identity/v3/users/8dd6694478264be6a134b2dfd8f4ab30 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:17.747972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:17.747972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:17.747972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:17.764478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:17.766139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:17.844866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:17.887263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b6b1-6755-4db7-bea0-26104e5ee947 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:17.908330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:17.937515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 911/1801] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:17.987118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:17.988647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:18.039809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:18.054626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.055224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.072615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.074966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:18.081140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:18.139221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 891/1802] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:17 2022] POST /identity/v3/users => generated 293 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:18.148254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:18.185043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bef63-d45f-423d-af61-466ee11a2b27 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:18.200420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:18.203144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.204638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.205091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.206377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:18.208919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:18.233259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 892/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:18.235616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:18.247281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2221dfc-548e-4d88-a4ee-1c5ca19c15c3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:18.261088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ece98a-217a-4978-9bb8-6b11aa291ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:18.261754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece98a-217a-4978-9bb8-6b11aa291ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.262031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece98a-217a-4978-9bb8-6b11aa291ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.262305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece98a-217a-4978-9bb8-6b11aa291ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.267749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47f37a-94b4-4563-8e09-20af5fc9b346 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:18.283916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:18.287398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.287736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.287967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.288631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:18.290260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:18.302960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ece98a-217a-4978-9bb8-6b11aa291ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:18.304621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ece98a-217a-4978-9bb8-6b11aa291ad6 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:18.339430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 893/1804] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:18.342348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:18.344087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 912/1805] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:18.368876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13acd8e-9342-4d46-a9b9-7c967214e1e7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:18.376140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:18.376926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.377157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.378126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] PATH_INFO: `/v3/projects/f4dc9bf41fe14b0bbbcd35809d6db00a/users/d14e12e3a37046d9ab0547969890c838/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.400655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dadc1-f0ce-41c2-b0be-2e0c3a00603f None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.401200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dadc1-f0ce-41c2-b0be-2e0c3a00603f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.401200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dadc1-f0ce-41c2-b0be-2e0c3a00603f None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.403597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 913/1806] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:18:18.408993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4dc9bf41fe14b0bbbcd35809d6db00a, user_id=d14e12e3a37046d9ab0547969890c838, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:18.413445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:18.438213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 894/1807] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:18 2022] PUT /identity/v3/projects/f4dc9bf41fe14b0bbbcd35809d6db00a/users/d14e12e3a37046d9ab0547969890c838/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:18.453300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7924-3afc-4dc9-aab8-46f2ec946b33 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.453419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7924-3afc-4dc9-aab8-46f2ec946b33 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.453766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7924-3afc-4dc9-aab8-46f2ec946b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.525050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-eb8c7924-3afc-4dc9-aab8-46f2ec946b33 None None] MFA Rules not processed for user `d14e12e3a37046d9ab0547969890c838`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:18.526628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eb8c7924-3afc-4dc9-aab8-46f2ec946b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:18.699131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 914/1808] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:18.700068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:18.715812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12774563-b347-4185-b423-bebd93524978 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:18.716352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12774563-b347-4185-b423-bebd93524978 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:18.716739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12774563-b347-4185-b423-bebd93524978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:18.789127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-12774563-b347-4185-b423-bebd93524978 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:18.790419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-12774563-b347-4185-b423-bebd93524978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:18.996073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 915/1809] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:19.008474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9e4fd-23fc-486e-88af-c446f90be67b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:19.083418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:19.089610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:19.093824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:19.094564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:19.098446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:19.130691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:19.204672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 895/1810] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:18 2022] POST /identity/v3/projects => generated 387 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:19.208002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12774563-b347-4185-b423-bebd93524978 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:19.227781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12774563-b347-4185-b423-bebd93524978 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:19.296070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:19.396370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:19.397379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:19.397890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:19.398390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:19.399955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:19.403818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:19.457736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 916/1811] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:19 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:19.461746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:19.528816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81018d3-6bc5-470d-8b87-ee5c44d7577a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:19.545648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:19.548998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:19.550642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:19.551283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:19.555701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:19.558988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:19.603978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 896/1812] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:19.610160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:19.613530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:19.624771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:19.673571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:19.711531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04021eef-723d-46e2-a15f-12943a125e76 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:19.731802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:19.733397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:19.733506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:19.733836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] PATH_INFO: `/v3/projects/86531be14d334f509847c34b5e28ae80/users/0f73742ae606408d99be6ceb634082b2/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:19.785912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86531be14d334f509847c34b5e28ae80, user_id=0f73742ae606408d99be6ceb634082b2, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:19.788637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:19.821392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 897/1813] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:19 2022] PUT /identity/v3/projects/86531be14d334f509847c34b5e28ae80/users/0f73742ae606408d99be6ceb634082b2/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:19.829385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:19.943180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00620024-7bb4-47b7-a7e7-2992041c2050 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:19.979753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a875a-5a39-4fb8-822a-9b4f6f7c0264 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:19.987261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:19.987904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:19.988260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:19.988654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:19.989860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:19.993067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:20.038018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 898/1814] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:20.067650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:20.110462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3c9b6-fcf7-4c70-af77-19a82e6bf9a8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:20.117782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8946fd8-649c-4356-9b0d-204514224e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:20.118458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946fd8-649c-4356-9b0d-204514224e21 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:20.118746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946fd8-649c-4356-9b0d-204514224e21 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:20.119021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946fd8-649c-4356-9b0d-204514224e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:20.123574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649689c-6e3c-4d59-a06b-54a8495832aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:20.124284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649689c-6e3c-4d59-a06b-54a8495832aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:20.125108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649689c-6e3c-4d59-a06b-54a8495832aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:20.125546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649689c-6e3c-4d59-a06b-54a8495832aa admin admin] PATH_INFO: `/v3/projects/86531be14d334f509847c34b5e28ae80/users/0f73742ae606408d99be6ceb634082b2/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:20.129398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649689c-6e3c-4d59-a06b-54a8495832aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=86531be14d334f509847c34b5e28ae80, user_id=0f73742ae606408d99be6ceb634082b2, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:20.131326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946fd8-649c-4356-9b0d-204514224e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:20.133043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649689c-6e3c-4d59-a06b-54a8495832aa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:20.134217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946fd8-649c-4356-9b0d-204514224e21 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:20.164712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 917/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:20.168158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 899/1816] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:20 2022] PUT /identity/v3/projects/86531be14d334f509847c34b5e28ae80/users/0f73742ae606408d99be6ceb634082b2/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:20.169113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d541ee-d1e7-44fb-9924-17d45c27f3b3 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:20.170131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:20.170275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d541ee-d1e7-44fb-9924-17d45c27f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:20.170775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:20.171287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d541ee-d1e7-44fb-9924-17d45c27f3b3 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:20.171915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:20.176218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 918/1817] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:18:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:18:20.234511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] MFA Rules not processed for user `0f73742ae606408d99be6ceb634082b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:20.236026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:20.294520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:20.295192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:20.295692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:20.379402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:20.391849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:20.572792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:20.588766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 900/1818] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:20.603869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:20.606503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:20.653364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 919/1819] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:20.716919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:20.725009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71105d77-9239-49ed-885f-9da4dc7323d2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:20.730335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:20.731638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:20.732335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:20.732977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:20.756181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:20.758370 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:20.795016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 901/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:21.156197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:21.158224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:21.291924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:21.293796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:21.425974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce003b-82cd-48aa-a5ab-d9c7b7d68e33 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:21.432590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:21.433481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:21.433838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:21.434242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] PATH_INFO: `/v3/projects/6203580aa2554407ae9c9ad55b6da8e4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:21.436754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6203580aa2554407ae9c9ad55b6da8e4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:21.455562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:21.595813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6203580aa2554407ae9c9ad55b6da8e4', 'request_id': 'req-e7c17640-4d06-4b5e-a33c-5199732ae0ba'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.609804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6203580aa2554407ae9c9ad55b6da8e4', 'request_id': 'req-e7c17640-4d06-4b5e-a33c-5199732ae0ba'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.612547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80af1e-f6eb-4c97-b06c-d45cea3c4f89 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:21.631856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6203580aa2554407ae9c9ad55b6da8e4', 'request_id': 'req-e7c17640-4d06-4b5e-a33c-5199732ae0ba'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.678493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] The token cache is being invalidate because project 6203580aa2554407ae9c9ad55b6da8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:21.678729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.684625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.695510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 920/1821] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:21 2022] DELETE /identity/v3/projects/6203580aa2554407ae9c9ad55b6da8e4 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:21.696941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:21.700712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:21.743815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:21.745573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:21.746655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:21.747219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] PATH_INFO: `/v3/users/0d47865e7d8c4a198ab140d1ba7017d7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:21.749117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d47865e7d8c4a198ab140d1ba7017d7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:21.752119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:21.866411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d47865e7d8c4a198ab140d1ba7017d7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.880891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d47865e7d8c4a198ab140d1ba7017d7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.882382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d47865e7d8c4a198ab140d1ba7017d7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.894574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d47865e7d8c4a198ab140d1ba7017d7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.895698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3516acce-ad1d-4ece-82c4-a00c48cd37fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d47865e7d8c4a198ab140d1ba7017d7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:21.911693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:21.922797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c17640-4d06-4b5e-a33c-5199732ae0ba admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:21.932703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:21.933445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:21.933725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:21.934044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] PATH_INFO: `/v3/users/2f5b08a0a944419f94c4e09c44c13413` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:21.938312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5b08a0a944419f94c4e09c44c13413)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:21.940526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 902/1822] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:21 2022] DELETE /identity/v3/users/0d47865e7d8c4a198ab140d1ba7017d7 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:21.943590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:21.945543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:21.945767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:21.946802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:21.997541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:21.999373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:22.030494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:22.050166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5b08a0a944419f94c4e09c44c13413'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.051112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5b08a0a944419f94c4e09c44c13413'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.063468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5b08a0a944419f94c4e09c44c13413'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.080607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5b08a0a944419f94c4e09c44c13413'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.097454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5b08a0a944419f94c4e09c44c13413'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.140045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 903/1823] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:22.142333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:22.145033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:22.157682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 921/1824] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:21 2022] DELETE /identity/v3/users/2f5b08a0a944419f94c4e09c44c13413 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:22.213087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:22.214868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:22.330723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa37f-a61f-447b-9885-9e2c08aa42e7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:22.438605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584213f9-f425-47e9-9a46-3762b68c6240 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:22.451564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:22.452536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:22.452643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:22.453003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:22.576239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:22.576884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:22.577161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:22.577435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:22.582459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:22.598467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:22.599990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:22.612183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 922/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:22.612669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:22.612957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:22.614398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:22.614963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb772-c6b8-4622-915a-5408da18db2e service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:22.634031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 904/1826] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:22.634227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353653d0-f394-4f31-a97f-7aa2ef1da014 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:22.639844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:22.640558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:22.640888 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:22.641191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] PATH_INFO: `/v3/users/d14e12e3a37046d9ab0547969890c838` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:22.642407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14e12e3a37046d9ab0547969890c838)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:22.644683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:22.682915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:22.742403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14e12e3a37046d9ab0547969890c838'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.743193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14e12e3a37046d9ab0547969890c838'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.761382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14e12e3a37046d9ab0547969890c838'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.762147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14e12e3a37046d9ab0547969890c838'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.773652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14e12e3a37046d9ab0547969890c838'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:22.830052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 923/1827] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:22 2022] DELETE /identity/v3/users/d14e12e3a37046d9ab0547969890c838 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:22.835209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:22.836229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:22.842222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:22.928030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:22.930886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:23.076077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:23.182661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 905/1828] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:23.207717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:23.209219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:23.308984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd7204-552b-406c-b173-c407a7090439 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:23.315657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:23.316973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:23.317731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:23.318402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:23.335494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:23.337143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:23.351891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 924/1829] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:23.946007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:23.948152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:23.961300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f6346-0e39-4c95-9b92-39f6918905ce None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:23.967143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:23.968548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:23.968946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:23.969319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] PATH_INFO: `/v3/projects/f4dc9bf41fe14b0bbbcd35809d6db00a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:23.970930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4dc9bf41fe14b0bbbcd35809d6db00a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:23.973275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.073015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.075200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.086929 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4dc9bf41fe14b0bbbcd35809d6db00a', 'request_id': 'req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.094918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4dc9bf41fe14b0bbbcd35809d6db00a', 'request_id': 'req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.098553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2344c-9b07-4f05-aff3-680602f834c3 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:24.105245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4dc9bf41fe14b0bbbcd35809d6db00a', 'request_id': 'req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.119569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] The token cache is being invalidate because project f4dc9bf41fe14b0bbbcd35809d6db00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:24.119964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.120736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.124904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 906/1830] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:23 2022] DELETE /identity/v3/projects/f4dc9bf41fe14b0bbbcd35809d6db00a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:24.128600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.131329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.240145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:24.240993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.241271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.241543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] PATH_INFO: `/v3/projects/291164e2ea8b404ca2b904e7e87fa648` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.242662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291164e2ea8b404ca2b904e7e87fa648)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:24.244602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.250715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f544b-8c49-49a9-b59c-1ce3e6ac415d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:24.256719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:24.258539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.259742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.260169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] PATH_INFO: `/v3/users/0f73742ae606408d99be6ceb634082b2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.262542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f73742ae606408d99be6ceb634082b2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:24.266069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.308294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:24.315469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291164e2ea8b404ca2b904e7e87fa648', 'request_id': 'req-829dd8b3-f62d-4cc0-92fd-3366da25b129'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.328557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291164e2ea8b404ca2b904e7e87fa648', 'request_id': 'req-829dd8b3-f62d-4cc0-92fd-3366da25b129'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.335049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f73742ae606408d99be6ceb634082b2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.338467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291164e2ea8b404ca2b904e7e87fa648', 'request_id': 'req-829dd8b3-f62d-4cc0-92fd-3366da25b129'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.346053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f73742ae606408d99be6ceb634082b2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.347013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f73742ae606408d99be6ceb634082b2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.350540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] The token cache is being invalidate because project 291164e2ea8b404ca2b904e7e87fa648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:24.350935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.351650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.353810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 925/1831] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:24 2022] DELETE /identity/v3/projects/291164e2ea8b404ca2b904e7e87fa648 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:24.354824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.359387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.360497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f73742ae606408d99be6ceb634082b2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.361495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d2d8646-1db2-4c32-86e4-62c55f16ec44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f73742ae606408d99be6ceb634082b2'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.368302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:24.402997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 907/1832] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:24 2022] DELETE /identity/v3/users/0f73742ae606408d99be6ceb634082b2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:24.407697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ae9e-482d-494d-adeb-1a1761ae06eb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.408143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ae9e-482d-494d-adeb-1a1761ae06eb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.408502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ae9e-482d-494d-adeb-1a1761ae06eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.433805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7bd8ae9e-482d-494d-adeb-1a1761ae06eb None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:24.436510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7bd8ae9e-482d-494d-adeb-1a1761ae06eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.455070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd8b3-f62d-4cc0-92fd-3366da25b129 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:24.527778 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 908/1833] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:24.532007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:24.532651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.532927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.533353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] PATH_INFO: `/v3/projects/1e1f5272741e46af880ee8e49b6b449c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.534808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1f5272741e46af880ee8e49b6b449c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:24.536414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.537260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.537636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.538015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.563506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:24.565387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.574697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 909/1834] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:24.591047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.593981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1f5272741e46af880ee8e49b6b449c', 'request_id': 'req-8db561a9-6859-4059-bfde-82115f36fc65'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.602427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850d074-a96f-49e8-a832-6b134a971f44 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:24.606138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1f5272741e46af880ee8e49b6b449c', 'request_id': 'req-8db561a9-6859-4059-bfde-82115f36fc65'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.615307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1f5272741e46af880ee8e49b6b449c', 'request_id': 'req-8db561a9-6859-4059-bfde-82115f36fc65'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.631612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] The token cache is being invalidate because project 1e1f5272741e46af880ee8e49b6b449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:24.632288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.632965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.637889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 926/1835] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:24 2022] DELETE /identity/v3/projects/1e1f5272741e46af880ee8e49b6b449c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:24.639255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.642413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.656380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:24.702617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:24.703453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.703841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.704229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.705394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:24.705554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:24.707353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.726249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 910/1836] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:24.727154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.729076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db561a9-6859-4059-bfde-82115f36fc65 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:24.731053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.742201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:24.743752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.744080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.744541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] PATH_INFO: `/v3/users/1c5a36ab3e2b4421b90f583d1af9a153` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.746681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5a36ab3e2b4421b90f583d1af9a153)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:24.748305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c667-a85b-49d3-af43-d9f59cafe569 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:24.750150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.755982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:24.756907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:24.757262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:24.757615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:24.758314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:24.767927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:24.813792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 911/1837] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:24 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:24.819289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.825416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5a36ab3e2b4421b90f583d1af9a153'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.826173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5a36ab3e2b4421b90f583d1af9a153'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.837798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5a36ab3e2b4421b90f583d1af9a153'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.839361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5a36ab3e2b4421b90f583d1af9a153'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.849075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5a36ab3e2b4421b90f583d1af9a153'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:24.875282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 927/1838] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:24 2022] DELETE /identity/v3/users/1c5a36ab3e2b4421b90f583d1af9a153 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:24.876175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:24.877755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:24.967847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:24.991194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b0225-f592-4c7c-87d1-21fa97ae482c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.000621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81429-a262-4c48-bc93-265771cf836a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.007878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.008343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.009060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.009321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.009570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.009757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.010098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.010281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.010416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] PATH_INFO: `/v3/projects/86531be14d334f509847c34b5e28ae80` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.012109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86531be14d334f509847c34b5e28ae80)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.013781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.014093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.058045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.059214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 912/1839] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:24 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:25.064867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.066805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.077634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86531be14d334f509847c34b5e28ae80', 'request_id': 'req-d41740b3-6c60-449b-9f4a-9e41ddd1af04'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.084986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969c12-ed1b-4dbf-92a8-6141ea67860c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.092463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86531be14d334f509847c34b5e28ae80', 'request_id': 'req-d41740b3-6c60-449b-9f4a-9e41ddd1af04'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.100772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86531be14d334f509847c34b5e28ae80', 'request_id': 'req-d41740b3-6c60-449b-9f4a-9e41ddd1af04'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.112635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] The token cache is being invalidate because project 86531be14d334f509847c34b5e28ae80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:25.112923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.113590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d41740b3-6c60-449b-9f4a-9e41ddd1af04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.118378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 928/1840] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:24 2022] DELETE /identity/v3/projects/86531be14d334f509847c34b5e28ae80 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:25.119803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a52c-9d7f-4f4e-87c8-d38fd6613f17 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.120127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a52c-9d7f-4f4e-87c8-d38fd6613f17 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.120396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a52c-9d7f-4f4e-87c8-d38fd6613f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.143013 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3414a52c-9d7f-4f4e-87c8-d38fd6613f17 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:25.144951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3414a52c-9d7f-4f4e-87c8-d38fd6613f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.165337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.165961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.166236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.166505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.167522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.169695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.183504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 913/1841] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:25.188455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.190993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.206996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e6d4d-fa5f-431b-931f-a5bce503615a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.213296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.214659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.215248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.215526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.216214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.217832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.225933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 929/1842] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:25.232999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 914/1843] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:25.233420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.233777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.234052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.234164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.247339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d227c7-e321-4b89-aba8-e87b693b820d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.253850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.254628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.254938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.255189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] PATH_INFO: `/v3/projects/d1170967ec1946efa264417a55bbfb81/users/623d29cfaf8a4f7fb3df9c5f824ed7b8/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.255856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:25.257114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.267147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 930/1844] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:25.271766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.277418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1170967ec1946efa264417a55bbfb81, user_id=623d29cfaf8a4f7fb3df9c5f824ed7b8, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.281547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.288075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b60ea-d756-4c1d-8ba4-715db542f2e8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.298283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 915/1845] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:25 2022] PUT /identity/v3/projects/d1170967ec1946efa264417a55bbfb81/users/623d29cfaf8a4f7fb3df9c5f824ed7b8/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:25.304327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.304327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.304327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.304327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.305180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:25.305180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.305180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395c445-6fbb-4c9a-9992-74577b3e6885 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.305375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.311429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.324416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 931/1846] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:25.326502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.327039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.327213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.366148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] MFA Rules not processed for user `623d29cfaf8a4f7fb3df9c5f824ed7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:25.367444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.395472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a257e-08ab-4d6d-bcd5-0fe842438229 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.400653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.401347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.401964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.401964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] PATH_INFO: `/v3/projects/96966d0c17044762956ffbf0c46f2bf3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.402981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96966d0c17044762956ffbf0c46f2bf3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.405093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.449640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 932/1847] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:25.449640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.456448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.460964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b394c9-d0b1-433a-9346-aeb2039fd6b1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.462830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96966d0c17044762956ffbf0c46f2bf3', 'request_id': 'req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.472430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96966d0c17044762956ffbf0c46f2bf3', 'request_id': 'req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.484495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96966d0c17044762956ffbf0c46f2bf3', 'request_id': 'req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.497069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] The token cache is being invalidate because project 96966d0c17044762956ffbf0c46f2bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:25.497069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.497706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:25.499468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 916/1848] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:25 2022] DELETE /identity/v3/projects/96966d0c17044762956ffbf0c46f2bf3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:25.500295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.501707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.504612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.552388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e89999-0d95-44a3-982c-565a436e54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.553224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e89999-0d95-44a3-982c-565a436e54d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.553569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e89999-0d95-44a3-982c-565a436e54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.553955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e89999-0d95-44a3-982c-565a436e54d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.554899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e89999-0d95-44a3-982c-565a436e54d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.557183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e89999-0d95-44a3-982c-565a436e54d6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.590894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 933/1849] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:25.592465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.592732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.593011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.605844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fe80a-70ab-49b1-9a9c-d9decef41eb7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.613764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:25.614972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.668901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485feef-462a-4da0-a8a3-522755fb49aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.669517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485feef-462a-4da0-a8a3-522755fb49aa admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.669844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485feef-462a-4da0-a8a3-522755fb49aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.670149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485feef-462a-4da0-a8a3-522755fb49aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.671966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485feef-462a-4da0-a8a3-522755fb49aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.674081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485feef-462a-4da0-a8a3-522755fb49aa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.680586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 934/1850] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:25.681587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.683101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.695951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23ded-1b94-427f-802d-d29284453c12 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.702935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.703624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.703999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.704326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.705072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.710499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.710637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 917/1851] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:25.710637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.710637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.710637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.731364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:25.732085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 935/1852] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:25.732742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:25.733247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.744336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c1c1-efe1-4db9-9cd9-3867742bf6eb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.811365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 918/1853] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:25.812452 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.818948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.819379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.819591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.819866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.820163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.820951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.823247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.826709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1114598-5f9a-4134-907e-b926f5bf6448 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.834235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.835045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.835323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.835601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.836467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.838105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.850322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 919/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:25.851175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.852737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 936/1855] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:25.854317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.863310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f07f-8e54-4e3e-b8ee-66665d9f12f2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.867658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6a1f-cfa2-4376-99ea-247bca460819 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.872762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.873450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.873720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.873989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.874689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:25.874991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.876618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.879756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.880390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.880674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.880965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.881600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.883312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.894742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 937/1856] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:25.895395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.900669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 920/1857] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:25.901522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.907782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470257d1-3acf-4dc4-96bb-98bd957eb355 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.912140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a34d0a-3fa6-4b49-8918-6f47846fbd26 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.917263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.917884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.918014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.918177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.918428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] PATH_INFO: `/v3/projects/848a0739d1c246fb8e5a035f98e60a4d/users/1cee01bda21d4291ab14abfaa489e10a/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.918763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.919102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.919714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.920791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.923210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.937817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 938/1858] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:25.938800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:25.949615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddef66-7727-406c-9bf5-915d3069addc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:25.950667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.952030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848a0739d1c246fb8e5a035f98e60a4d, user_id=1cee01bda21d4291ab14abfaa489e10a, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.955670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.955795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e75c-2a9a-4238-96f0-95053dbda5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:25.956605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e75c-2a9a-4238-96f0-95053dbda5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:25.956927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e75c-2a9a-4238-96f0-95053dbda5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:25.957208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e75c-2a9a-4238-96f0-95053dbda5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:25.959232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e75c-2a9a-4238-96f0-95053dbda5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:25.961852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e75c-2a9a-4238-96f0-95053dbda5ac admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:25.972460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 921/1859] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:25 2022] PUT /identity/v3/projects/848a0739d1c246fb8e5a035f98e60a4d/users/1cee01bda21d4291ab14abfaa489e10a/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:25.973365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.002649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 939/1860] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:25 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:26.004184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.004647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.004915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.035392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] MFA Rules not processed for user `1cee01bda21d4291ab14abfaa489e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:26.041385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:26.058338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c5b7-89fe-4095-b0bf-ae0b804d0e23 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.142607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 940/1861] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:26.144827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.151413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.152544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.153366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.153366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] PATH_INFO: `/v3/projects/7c5b220653f346359ab3b421ec96ebcc/users/cbe0b51c7a7f4f2f9af3e9dd307764a6/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.160438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d22f07-b0ee-45ce-95d9-4a01fe7f04c2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.166238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.167002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.167467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.167847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.168651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.170842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.172324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b220653f346359ab3b421ec96ebcc, user_id=cbe0b51c7a7f4f2f9af3e9dd307764a6, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.175542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.191485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 922/1862] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:25 2022] PUT /identity/v3/projects/7c5b220653f346359ab3b421ec96ebcc/users/cbe0b51c7a7f4f2f9af3e9dd307764a6/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:26.192193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.197890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 941/1863] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:26.197890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.206740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8a47d-52f1-4bff-8d18-5b4d537b8383 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.261282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:26.272983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.273604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.273883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.274156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.274801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.276436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.278700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2de07-94e4-4f65-b9ca-5cd9aa2347da admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.283492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.284216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.284518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.284804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.285463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.286028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 942/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:26.286909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.287469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.297783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9418572-b2b3-441b-ae0d-ac6448a88a6f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.302444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.303233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.303626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.303626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.304297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.305872 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.317601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 943/1865] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:26.318716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.333001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de0253-fdf5-4316-9f66-eeb1e69b94a8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.338273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 923/1866] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:26.339107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.342794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.343579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.343857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.344159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] PATH_INFO: `/v3/projects/7c5b220653f346359ab3b421ec96ebcc/users/cbe0b51c7a7f4f2f9af3e9dd307764a6/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.346362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5b220653f346359ab3b421ec96ebcc, user_id=cbe0b51c7a7f4f2f9af3e9dd307764a6, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.349038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.361240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 944/1867] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:26 2022] PUT /identity/v3/projects/7c5b220653f346359ab3b421ec96ebcc/users/cbe0b51c7a7f4f2f9af3e9dd307764a6/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:26.362159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.395370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:26.420769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d325-6597-422e-a9eb-624591387f3b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.432868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626a483-d5f4-41ab-8b85-96e5e94a70a9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.437987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc98f1b-5e47-4d96-8865-234e641f17f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.438646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc98f1b-5e47-4d96-8865-234e641f17f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.438929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc98f1b-5e47-4d96-8865-234e641f17f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.439238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc98f1b-5e47-4d96-8865-234e641f17f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.439900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc98f1b-5e47-4d96-8865-234e641f17f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.441945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc98f1b-5e47-4d96-8865-234e641f17f1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.468414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 945/1868] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:26.469703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.469991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.470269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.487835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.488483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.488756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.489024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.489681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.491248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.500776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] MFA Rules not processed for user `cbe0b51c7a7f4f2f9af3e9dd307764a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:26.501900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 924/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:26.502249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:26.502727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.514996 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c401-131c-4993-9a01-3fac8191933c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.519701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.520361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.520635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.520904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.521568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.523153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.534827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 925/1870] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:26.538808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.548627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb2c9-0542-4af6-89a6-14e76468ae47 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.564083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.564083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.564083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.564083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] PATH_INFO: `/v3/projects/20bb64f94ef7403bbdc48be4acb38ac5/users/19790d9cdbed422bac692cecc95f1eba/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.570804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bb64f94ef7403bbdc48be4acb38ac5, user_id=19790d9cdbed422bac692cecc95f1eba, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.573528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.578634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 946/1871] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:26.579968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.590986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e46a-e8d4-43ae-98b3-94cc10dae2e9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.597447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 926/1872] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:26 2022] PUT /identity/v3/projects/20bb64f94ef7403bbdc48be4acb38ac5/users/19790d9cdbed422bac692cecc95f1eba/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:26.598299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.601587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:26.649024 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:26.663527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bdc8b-a0a1-4597-943f-cdf283251cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.664255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdc8b-a0a1-4597-943f-cdf283251cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.664536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdc8b-a0a1-4597-943f-cdf283251cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.664833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdc8b-a0a1-4597-943f-cdf283251cdd admin admin] PATH_INFO: `/v3/projects/b8d67395be1146a39666f1d5b4095399/users/12a66f0b246d4a44ac4396866cb08a7c/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.665236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca7e90-fde3-4c65-942b-69f3cb510a6a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.669256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.669869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.670139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.670411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.681727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bdc8b-a0a1-4597-943f-cdf283251cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d67395be1146a39666f1d5b4095399, user_id=12a66f0b246d4a44ac4396866cb08a7c, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.685293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bdc8b-a0a1-4597-943f-cdf283251cdd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.700955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 947/1873] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:26 2022] PUT /identity/v3/projects/b8d67395be1146a39666f1d5b4095399/users/12a66f0b246d4a44ac4396866cb08a7c/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:26.702428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.702805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.703151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.731903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] MFA Rules not processed for user `19790d9cdbed422bac692cecc95f1eba`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:26.733241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:26.744339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.745602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:26.745799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.757440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 927/1874] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:26.758368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.769783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f8302-d591-4dcb-9d42-d46687ebc748 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.829034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 948/1875] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:26.829916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.834097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:26.851790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.852599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.852956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.853343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.854087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.855782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.867495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 928/1876] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:26.868914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.879054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac853e-8afd-498e-953c-7097943300de admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.884283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.884890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.885195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.885504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.886444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.888404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.898694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a673683-ff6e-4017-8165-999db65a28c6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:26.902416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:26.903030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:26.903311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:26.903588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:26.905345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:26.917055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 929/1877] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:26.917957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.970104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:26.970952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:26.982401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 949/1878] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:26.983348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:26.999018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35a16d-2a53-4955-9c76-04e7e36f8884 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.004238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574adb90-442d-43dd-8d68-dad9d339b3c4 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.009583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada60458-9edd-485a-8426-2112fcf39997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.011082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada60458-9edd-485a-8426-2112fcf39997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.011734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada60458-9edd-485a-8426-2112fcf39997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.012181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada60458-9edd-485a-8426-2112fcf39997 admin admin] PATH_INFO: `/v3/projects/b8d67395be1146a39666f1d5b4095399/users/12a66f0b246d4a44ac4396866cb08a7c/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.014249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada60458-9edd-485a-8426-2112fcf39997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d67395be1146a39666f1d5b4095399, user_id=12a66f0b246d4a44ac4396866cb08a7c, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.018545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.019242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.019587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.019928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.020651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.023624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada60458-9edd-485a-8426-2112fcf39997 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.024012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.043464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:27.053510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 930/1879] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:26 2022] PUT /identity/v3/projects/b8d67395be1146a39666f1d5b4095399/users/12a66f0b246d4a44ac4396866cb08a7c/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:27.065485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.065846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.066188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.084399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 950/1880] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:26 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:27.088268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:27.105649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2f24-ba02-4c77-86ed-bb5f20df2465 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.109012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] MFA Rules not processed for user `12a66f0b246d4a44ac4396866cb08a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:27.110384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:27.210998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:27.236994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.240224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.240622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.241761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.242547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.246850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.262773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 951/1881] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:27.267288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:27.284764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 931/1882] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:27.284896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4257759-93d6-4b9f-a874-3ad57aa969c6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.291507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.292611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.293012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.293389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] PATH_INFO: `/v3/projects/d3ed071440554bc09579c7ad92d08a8f/users/6cf4b9e750ab432ea7835659ebf65f02/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.313062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ed071440554bc09579c7ad92d08a8f, user_id=6cf4b9e750ab432ea7835659ebf65f02, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.316503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.334621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 952/1883] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:27 2022] PUT /identity/v3/projects/d3ed071440554bc09579c7ad92d08a8f/users/6cf4b9e750ab432ea7835659ebf65f02/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:27.339028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:27.356856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4db65-796a-4a25-bec2-2174f4f963ca None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.395639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:27.484892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8988b-a74b-4d2f-b6fd-8094a076d392 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.490831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.491503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.492150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.492391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.492533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.493053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.493337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.493615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.494377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.496246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.517020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 932/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:27.517020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:27.528540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b22e-cb1f-440b-9c27-7b67dc00cceb admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.552439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d1c1d-4f2e-4cc0-9f2a-2c3f63aab236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.552439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1c1d-4f2e-4cc0-9f2a-2c3f63aab236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.552439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1c1d-4f2e-4cc0-9f2a-2c3f63aab236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.552439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d1c1d-4f2e-4cc0-9f2a-2c3f63aab236 admin admin] PATH_INFO: `/v3/projects/d3ed071440554bc09579c7ad92d08a8f/users/6cf4b9e750ab432ea7835659ebf65f02/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.552868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d1c1d-4f2e-4cc0-9f2a-2c3f63aab236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ed071440554bc09579c7ad92d08a8f, user_id=6cf4b9e750ab432ea7835659ebf65f02, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.552868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d1c1d-4f2e-4cc0-9f2a-2c3f63aab236 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.584674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 933/1885] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:27 2022] PUT /identity/v3/projects/d3ed071440554bc09579c7ad92d08a8f/users/6cf4b9e750ab432ea7835659ebf65f02/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:27.598421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.598715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.598980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.632897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.637059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:27.656821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] MFA Rules not processed for user `6cf4b9e750ab432ea7835659ebf65f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:27.658397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:27.661423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 953/1886] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:27.738777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:27.774238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 934/1887] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:27.786383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:27.796864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b032b8-1fa2-4916-9bd1-d77fc0dcb290 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:27.960357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:27.960996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:27.961322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:27.961602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:27.990659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:27.994743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:28.008719 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 954/1888] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:28.057006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:28.140877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8d43e-3779-4ae9-bc0b-a2a0dc11f3ae None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:28.147264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:28.148239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:28.148614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:28.149130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] PATH_INFO: `/v3/users/19790d9cdbed422bac692cecc95f1eba` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:28.150556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19790d9cdbed422bac692cecc95f1eba)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:28.152927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:28.222041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19790d9cdbed422bac692cecc95f1eba'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.231919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:28.235091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19790d9cdbed422bac692cecc95f1eba'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.235848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19790d9cdbed422bac692cecc95f1eba'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.244928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19790d9cdbed422bac692cecc95f1eba'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.245676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-80d75c06-ed97-409c-85ed-0453c4f02095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19790d9cdbed422bac692cecc95f1eba'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.247023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d274-3ed5-43d4-95c6-e6a182a9d84a service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:28.257797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:28.258342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:28.258826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:28.258958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] PATH_INFO: `/v3/users/1cee01bda21d4291ab14abfaa489e10a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:28.265032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cee01bda21d4291ab14abfaa489e10a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:28.265032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:28.288344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 935/1889] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:28 2022] DELETE /identity/v3/users/19790d9cdbed422bac692cecc95f1eba => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:28.299241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:28.300889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:28.302917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:28.305306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:28.377385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:28.379256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:28.431707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cee01bda21d4291ab14abfaa489e10a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.432531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cee01bda21d4291ab14abfaa489e10a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.441510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cee01bda21d4291ab14abfaa489e10a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.442329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cee01bda21d4291ab14abfaa489e10a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.452048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3ad88e89-96ee-4339-9be5-1e355497e53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cee01bda21d4291ab14abfaa489e10a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:28.472710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 955/1890] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:28 2022] DELETE /identity/v3/users/1cee01bda21d4291ab14abfaa489e10a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:28.475988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 936/1891] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:28.477984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:28.478335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:28.478711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:28.484396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:28.485965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:28.501368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:28.502202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:28.502776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:28.569418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69020a-41ed-4758-b6ab-e5588e2121d3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:28.577128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 956/1892] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:28.584661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:28.655982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d951d2-4f31-4b0c-8b82-6dcabeb3e6e5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:28.659927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:28.660561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:28.660841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:28.661113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:28.675046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:28.676533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:28.692166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:28.695970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:28.697423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:28.707365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:28.710248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 957/1893] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:28.736933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:28.738943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:28.757992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 937/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:29.697339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:29.698865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:29.719445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f63a72-446f-45c9-883d-7b0394fb14c4 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:29.721839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:29.723555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:29.726534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:29.727702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:29.727999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:29.728276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] PATH_INFO: `/v3/projects/20bb64f94ef7403bbdc48be4acb38ac5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:29.729550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bb64f94ef7403bbdc48be4acb38ac5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:29.733253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:29.743028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f69d-2957-4f96-96a7-43a04e6fb710 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:29.748644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:29.749770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:29.750046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:29.750319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] PATH_INFO: `/v3/projects/848a0739d1c246fb8e5a035f98e60a4d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:29.751442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848a0739d1c246fb8e5a035f98e60a4d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:29.753363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:29.779426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:29.808116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bb64f94ef7403bbdc48be4acb38ac5', 'request_id': 'req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.815677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bb64f94ef7403bbdc48be4acb38ac5', 'request_id': 'req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.828476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bb64f94ef7403bbdc48be4acb38ac5', 'request_id': 'req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.837066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848a0739d1c246fb8e5a035f98e60a4d', 'request_id': 'req-7072efb4-f397-4d8a-9b6b-5fa58c93b677'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.840446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] The token cache is being invalidate because project 20bb64f94ef7403bbdc48be4acb38ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:29.840738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.841403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06dac87b-a0cd-42a0-8b55-5cc1b0b423db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.843502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 958/1895] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:29 2022] DELETE /identity/v3/projects/20bb64f94ef7403bbdc48be4acb38ac5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:29.846599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef9b0-6798-4ee2-808d-4fa88f2ae7a0 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:29.846599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef9b0-6798-4ee2-808d-4fa88f2ae7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:29.846599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef9b0-6798-4ee2-808d-4fa88f2ae7a0 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:29.846824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 959/1896] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:18:29.847475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef9b0-6798-4ee2-808d-4fa88f2ae7a0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:29.849573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1e8ef9b0-6798-4ee2-808d-4fa88f2ae7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:29.850170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848a0739d1c246fb8e5a035f98e60a4d', 'request_id': 'req-7072efb4-f397-4d8a-9b6b-5fa58c93b677'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.860464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848a0739d1c246fb8e5a035f98e60a4d', 'request_id': 'req-7072efb4-f397-4d8a-9b6b-5fa58c93b677'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.878720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] The token cache is being invalidate because project 848a0739d1c246fb8e5a035f98e60a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:29.879079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.879887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7072efb4-f397-4d8a-9b6b-5fa58c93b677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:29.881791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 938/1897] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:29 2022] DELETE /identity/v3/projects/848a0739d1c246fb8e5a035f98e60a4d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:29.883497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:29.883871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:29.884235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:29.907888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:29.909133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:29.931298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef9b0-6798-4ee2-808d-4fa88f2ae7a0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:29.936672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:29.937495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:29.937790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:29.938052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] PATH_INFO: `/v3/users/6cf4b9e750ab432ea7835659ebf65f02` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:29.939384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf4b9e750ab432ea7835659ebf65f02)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:29.941645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:29.963300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:29.996348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 939/1898] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:29.997537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:29.999332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:30.024765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4d6b6-d623-4d6e-94e8-66d31f9c22bb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:30.030012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:30.030760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:30.031315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:30.031437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] PATH_INFO: `/v3/users/12a66f0b246d4a44ac4396866cb08a7c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:30.032642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a66f0b246d4a44ac4396866cb08a7c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:30.035250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:30.036622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf4b9e750ab432ea7835659ebf65f02'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.038191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf4b9e750ab432ea7835659ebf65f02'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.049260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf4b9e750ab432ea7835659ebf65f02'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.050314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf4b9e750ab432ea7835659ebf65f02'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.060109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf4b9e750ab432ea7835659ebf65f02'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.092293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a66f0b246d4a44ac4396866cb08a7c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.094850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 960/1899] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:29 2022] DELETE /identity/v3/users/6cf4b9e750ab432ea7835659ebf65f02 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:30.095967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:30.097456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:30.106433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a66f0b246d4a44ac4396866cb08a7c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.107437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a66f0b246d4a44ac4396866cb08a7c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.116791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a66f0b246d4a44ac4396866cb08a7c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.117795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a66f0b246d4a44ac4396866cb08a7c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:30.137085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:30.139073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 940/1900] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:29 2022] DELETE /identity/v3/users/12a66f0b246d4a44ac4396866cb08a7c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:30.196210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc28b89-b7d8-4de4-ab53-aac995b10a88 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:30.301241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:30.302165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:30.302670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:30.302946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:30.305528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:30.325193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:30.329376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:30.359251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 961/1901] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:30.734411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:30.735901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:30.742670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:30.744825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:30.950666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8173e-36dd-4373-b2f8-0f31202f1f5e service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:30.964194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3529-0527-42a5-a87c-3e61e844d518 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:30.964667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:30.966138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:30.966932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:30.968463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] PATH_INFO: `/v3/projects/b8d67395be1146a39666f1d5b4095399` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:30.973608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d67395be1146a39666f1d5b4095399)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:30.979554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:30.987000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:30.989036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:30.990642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:30.991063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] PATH_INFO: `/v3/projects/d3ed071440554bc09579c7ad92d08a8f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.001521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ed071440554bc09579c7ad92d08a8f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.005316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.099142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d67395be1146a39666f1d5b4095399', 'request_id': 'req-ed5ee245-503a-41a3-bbbd-788df170fba1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.110245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d67395be1146a39666f1d5b4095399', 'request_id': 'req-ed5ee245-503a-41a3-bbbd-788df170fba1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.113303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:31.122607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d67395be1146a39666f1d5b4095399', 'request_id': 'req-ed5ee245-503a-41a3-bbbd-788df170fba1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.130516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ed071440554bc09579c7ad92d08a8f', 'request_id': 'req-135e6c56-08d9-4179-bf1c-f79c305eaec5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.140676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] The token cache is being invalidate because project b8d67395be1146a39666f1d5b4095399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:31.141150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.141931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ed5ee245-503a-41a3-bbbd-788df170fba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.147976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 962/1902] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:30 2022] DELETE /identity/v3/projects/b8d67395be1146a39666f1d5b4095399 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:31.149530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ed071440554bc09579c7ad92d08a8f', 'request_id': 'req-135e6c56-08d9-4179-bf1c-f79c305eaec5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.150823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4392a-62aa-48c0-86f8-8d3f6fbf4fb7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.153917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:31.154805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4392a-62aa-48c0-86f8-8d3f6fbf4fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.156936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4392a-62aa-48c0-86f8-8d3f6fbf4fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.161773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ed071440554bc09579c7ad92d08a8f', 'request_id': 'req-135e6c56-08d9-4179-bf1c-f79c305eaec5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.210727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-55b4392a-62aa-48c0-86f8-8d3f6fbf4fb7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:31.211594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] The token cache is being invalidate because project d3ed071440554bc09579c7ad92d08a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:31.211905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55b4392a-62aa-48c0-86f8-8d3f6fbf4fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.214879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.216007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-135e6c56-08d9-4179-bf1c-f79c305eaec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.225494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 941/1903] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:30 2022] DELETE /identity/v3/projects/d3ed071440554bc09579c7ad92d08a8f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:31.242197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746feb7-c506-41dc-a72a-083e6b4ed1c7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.242550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746feb7-c506-41dc-a72a-083e6b4ed1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.242970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746feb7-c506-41dc-a72a-083e6b4ed1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.279336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1746feb7-c506-41dc-a72a-083e6b4ed1c7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:31.283815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1746feb7-c506-41dc-a72a-083e6b4ed1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.286383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 963/1904] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:31.294407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.295599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.296107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.301749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 942/1905] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:31.309737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.310096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.310496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.321827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:31.323211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.333949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 964/1906] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:31.337208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:31.338565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.340262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.354947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 943/1907] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:31.355133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66284f-32df-49b5-ae28-b341ad999750 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.355515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.361325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.362668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.363023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.363380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.364224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:31.364609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.366307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.368851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1252b-b1d9-43cc-9385-30a22a1003f5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.376839 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.378184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.379010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.379823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.380950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:31.381440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.383391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.386250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 965/1908] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:31.387343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.399396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d708c-f6d9-41ef-a403-a76ffd917645 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.401409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 944/1909] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:31.405492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.409269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.410126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.410399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.410678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.411820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.414243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.423324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e24cca-3f5e-447c-b725-5c81980781fc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.431159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.432280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.433139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.433742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.435526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.438154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.468179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 966/1910] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:31.469216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.505193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 945/1911] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:31.507327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.593656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7870d-31da-465d-81da-2827c0dece79 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.605265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.605265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.605265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.605265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.605698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.607289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.629670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a60f-2608-497f-ac83-3d8ad29cbcc6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.639526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.640991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.642019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.642486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.643333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.645903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 946/1912] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:31.646503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.646932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.648813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.664890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52aaaa-d880-4cc2-9377-2bfcf0da08cc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.673414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.674251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.674804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.675207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] PATH_INFO: `/v3/users/623d29cfaf8a4f7fb3df9c5f824ed7b8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.677183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623d29cfaf8a4f7fb3df9c5f824ed7b8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.677955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 967/1913] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:31.679284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.683380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.693655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfcd6-f527-438d-a0d0-5e079ba3a111 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.700774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.701699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.702162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.702561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.703532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.706754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.728669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 968/1914] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:31.729785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.742642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ccd8-fdfe-4037-ab26-3eea9142c7c5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.760029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.760921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623d29cfaf8a4f7fb3df9c5f824ed7b8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.761593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.761593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.761736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.762354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.764661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.770039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623d29cfaf8a4f7fb3df9c5f824ed7b8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.770816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623d29cfaf8a4f7fb3df9c5f824ed7b8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.781133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 969/1915] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:31.781133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.782382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623d29cfaf8a4f7fb3df9c5f824ed7b8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.783241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623d29cfaf8a4f7fb3df9c5f824ed7b8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:31.789222 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aead3f-28a7-417e-8825-ce5479a1464e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.793851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc505-9e07-4356-b19f-cc0ab4a755ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.794449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc505-9e07-4356-b19f-cc0ab4a755ff admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.794720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc505-9e07-4356-b19f-cc0ab4a755ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.794988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc505-9e07-4356-b19f-cc0ab4a755ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.795618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc505-9e07-4356-b19f-cc0ab4a755ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.797776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc505-9e07-4356-b19f-cc0ab4a755ff admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.802444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:31.809122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 947/1916] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:31 2022] DELETE /identity/v3/users/623d29cfaf8a4f7fb3df9c5f824ed7b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:31.810775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.815670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.818010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 970/1917] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:31.819275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.819556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.819829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.832010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:31.847431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:31.848759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.886619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e59e4-e8e8-4984-84fd-62201010a2f8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.891730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.892387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.892664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.892938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.893579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.895176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.904956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 948/1918] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:31.908219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.908219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.913089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 971/1919] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:31.913968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.921107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddf3a-6424-4e9f-bc28-ea69f56eac58 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.923551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4ceb8-33ed-43dc-aa9e-d548b8d0e54e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:31.926029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.926676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.926955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.927235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] PATH_INFO: `/v3/projects/2b6bf3a771a5467ea0c4f152c8d03ab4/users/02f68dbf575c4ed9ba1c3ff8c6b99656/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.928467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4a42a-804d-4bb2-85fa-bc7f9d38b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:31.929280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4a42a-804d-4bb2-85fa-bc7f9d38b69b admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.929559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4a42a-804d-4bb2-85fa-bc7f9d38b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.929829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4a42a-804d-4bb2-85fa-bc7f9d38b69b admin admin] PATH_INFO: `/v3/projects/be9e5e930d70494eae2c4712b0c5a227/users/6f3cccdcb8ee46b684c854a0ffc444a5/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.942585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6bf3a771a5467ea0c4f152c8d03ab4, user_id=02f68dbf575c4ed9ba1c3ff8c6b99656, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.944818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4a42a-804d-4bb2-85fa-bc7f9d38b69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9e5e930d70494eae2c4712b0c5a227, user_id=6f3cccdcb8ee46b684c854a0ffc444a5, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:31.945278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.947419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4a42a-804d-4bb2-85fa-bc7f9d38b69b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:31.958713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 949/1920] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:31 2022] PUT /identity/v3/projects/2b6bf3a771a5467ea0c4f152c8d03ab4/users/02f68dbf575c4ed9ba1c3ff8c6b99656/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:31.959604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:31.967279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 972/1921] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:31 2022] PUT /identity/v3/projects/be9e5e930d70494eae2c4712b0c5a227/users/6f3cccdcb8ee46b684c854a0ffc444a5/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:31.967414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:31.969883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0fc75-8435-42c3-91db-668a75b90e51 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:31.970263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0fc75-8435-42c3-91db-668a75b90e51 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:31.970660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0fc75-8435-42c3-91db-668a75b90e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:31.998077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2fe0fc75-8435-42c3-91db-668a75b90e51 None None] MFA Rules not processed for user `02f68dbf575c4ed9ba1c3ff8c6b99656`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:32.000181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2fe0fc75-8435-42c3-91db-668a75b90e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:32.029364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b1f7-0018-4c8f-b19a-67f6fbc70405 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.081710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 973/1922] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:32.083264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.083554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.084028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.104369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.105020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.105302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.105680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.117942 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] MFA Rules not processed for user `6f3cccdcb8ee46b684c854a0ffc444a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:32.120102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:32.165940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:32.196646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.198142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.208741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 950/1923] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:32.209945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.217642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:32.222142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d04c4a-0de4-425f-8509-2abcc05aa60c service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.227666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.227808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 974/1924] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:32.228394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.228699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.228945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.229636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.231767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.241198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.243842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:32.282404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 951/1925] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:32 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:32.287455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.372100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca7298-8ad9-457c-8661-dd0d6543b187 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.378537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.378763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.379014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.379292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.379961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.381968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.383502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c3ae-aa2f-477f-933c-3354fb17f4ae None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.422308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 952/1926] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:32 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:32.424237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.444415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565a14-5954-46e3-bb77-382c90a4d298 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.451264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.451950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.452781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.453659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.454742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.456692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.474120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.474931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.475322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.476020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.476134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 953/1927] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:32.477408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.489441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dba3fa-cbe3-4f8f-90bd-4776768a0c3c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.500698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.501423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.502012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.502119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] PATH_INFO: `/v3/projects/0736410d88fc4e9eb6413b41988bb332/users/f27f516fda994928974fd9e07448a0c6/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.524599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0736410d88fc4e9eb6413b41988bb332, user_id=f27f516fda994928974fd9e07448a0c6, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.529749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.560461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 954/1928] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:32 2022] PUT /identity/v3/projects/0736410d88fc4e9eb6413b41988bb332/users/f27f516fda994928974fd9e07448a0c6/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:32.565715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.581052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.582636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.598887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 975/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:32.623426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.635915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa76b-2672-4d78-ba49-5e2f02ac2ea7 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.656819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d025c0b-ede3-49dc-b431-0fc894a10b80 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.661846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.662545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.662830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.663115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.664253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.666160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.685277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 955/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:32.686970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.690442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:32.708117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf01c9f-1b6e-4118-b0e0-fa6d94e23496 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.710540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.711205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.711485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.711764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] PATH_INFO: `/v3/users/6f3cccdcb8ee46b684c854a0ffc444a5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.712605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.713243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.713526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.713630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3cccdcb8ee46b684c854a0ffc444a5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.713801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] PATH_INFO: `/v3/projects/d1170967ec1946efa264417a55bbfb81` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.714934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1170967ec1946efa264417a55bbfb81)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.715640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.716881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.719384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:32.732057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:32.779588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1170967ec1946efa264417a55bbfb81', 'request_id': 'req-ab9c9e08-a811-4153-9f89-a5d4cc98e147'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.780077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3cccdcb8ee46b684c854a0ffc444a5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.781697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3cccdcb8ee46b684c854a0ffc444a5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.788921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1170967ec1946efa264417a55bbfb81', 'request_id': 'req-ab9c9e08-a811-4153-9f89-a5d4cc98e147'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.791375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3cccdcb8ee46b684c854a0ffc444a5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.792553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3cccdcb8ee46b684c854a0ffc444a5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.803577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1170967ec1946efa264417a55bbfb81', 'request_id': 'req-ab9c9e08-a811-4153-9f89-a5d4cc98e147'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.820151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] The token cache is being invalidate because project d1170967ec1946efa264417a55bbfb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:32.820151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.820712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.823201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 956/1931] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:32 2022] DELETE /identity/v3/projects/d1170967ec1946efa264417a55bbfb81 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:32.824156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.825963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:32.828976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3cccdcb8ee46b684c854a0ffc444a5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.851180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 976/1932] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:32 2022] DELETE /identity/v3/users/6f3cccdcb8ee46b684c854a0ffc444a5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:32.854692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:32.856087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:32.912269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9e08-a811-4153-9f89-a5d4cc98e147 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.927779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628affa7-677d-415f-9c90-35e527bd5282 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:32.932130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.932916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.933273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.933612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] PATH_INFO: `/v3/users/cbe0b51c7a7f4f2f9af3e9dd307764a6` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.934803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe0b51c7a7f4f2f9af3e9dd307764a6)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.936853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.978223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed809ec-2c45-4876-bf12-7fe31ddf2943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:32.979128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed809ec-2c45-4876-bf12-7fe31ddf2943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:32.979410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed809ec-2c45-4876-bf12-7fe31ddf2943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:32.979684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed809ec-2c45-4876-bf12-7fe31ddf2943 admin admin] PATH_INFO: `/v3/projects/0736410d88fc4e9eb6413b41988bb332/users/f27f516fda994928974fd9e07448a0c6/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:32.981743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed809ec-2c45-4876-bf12-7fe31ddf2943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0736410d88fc4e9eb6413b41988bb332, user_id=f27f516fda994928974fd9e07448a0c6, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:32.984562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed809ec-2c45-4876-bf12-7fe31ddf2943 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:32.989959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe0b51c7a7f4f2f9af3e9dd307764a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.990615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe0b51c7a7f4f2f9af3e9dd307764a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:32.994667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 957/1933] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:32 2022] PUT /identity/v3/projects/0736410d88fc4e9eb6413b41988bb332/users/f27f516fda994928974fd9e07448a0c6/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:33.004398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181986-04cb-4164-8f72-62889f180abe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.004398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181986-04cb-4164-8f72-62889f180abe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.004398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181986-04cb-4164-8f72-62889f180abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.008278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe0b51c7a7f4f2f9af3e9dd307764a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.009065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe0b51c7a7f4f2f9af3e9dd307764a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.016338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dc181986-04cb-4164-8f72-62889f180abe None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:33.017445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6fabdfe0-071d-40a0-84af-a2d4fded17db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe0b51c7a7f4f2f9af3e9dd307764a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.017597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc181986-04cb-4164-8f72-62889f180abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:33.036808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 977/1934] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:32 2022] DELETE /identity/v3/users/cbe0b51c7a7f4f2f9af3e9dd307764a6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:33.038101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.038462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.038831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.052981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:33.054793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:33.071567 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] MFA Rules not processed for user `f27f516fda994928974fd9e07448a0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:33.072948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:33.098685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 958/1935] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:33.111861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc181986-04cb-4164-8f72-62889f180abe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:33.115632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc181986-04cb-4164-8f72-62889f180abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:33.187651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 978/1936] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:33.187850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc181986-04cb-4164-8f72-62889f180abe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:33.200766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:33.203479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:33.314108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7e917-77c5-4a2a-b7eb-136f51542662 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:33.326464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:33.327702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.328468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.328953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.341859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:33.342196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:33.344696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:33.344824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.345036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.345318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.360790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 979/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:33.467568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:33.470153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:33.483420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 959/1938] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:33.585070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:33.587504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:33.606208 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:33.608296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:33.636792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581374b4-b077-4231-9ec5-6c6b8da4aa94 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:33.644282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7d1e0-dc2e-4428-867e-8e353d6ebb24 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:33.654577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:33.656478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.656758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.657033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] PATH_INFO: `/v3/users/02f68dbf575c4ed9ba1c3ff8c6b99656` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.664235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:33.664901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.665177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.665448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] PATH_INFO: `/v3/projects/7c5b220653f346359ab3b421ec96ebcc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.666806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f68dbf575c4ed9ba1c3ff8c6b99656)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:33.673652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5b220653f346359ab3b421ec96ebcc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:33.674150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:33.680334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:33.860649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:33.868338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f68dbf575c4ed9ba1c3ff8c6b99656'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.870055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f68dbf575c4ed9ba1c3ff8c6b99656'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.882394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f68dbf575c4ed9ba1c3ff8c6b99656'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.889176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f68dbf575c4ed9ba1c3ff8c6b99656'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.902777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5b220653f346359ab3b421ec96ebcc', 'request_id': 'req-4484c082-916b-449a-8ea6-afee913e05e7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.907953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f5e3ff2a-ba36-4d31-8ca4-e6e220eff24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f68dbf575c4ed9ba1c3ff8c6b99656'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.930633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5b220653f346359ab3b421ec96ebcc', 'request_id': 'req-4484c082-916b-449a-8ea6-afee913e05e7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.949682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 980/1939] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:33 2022] DELETE /identity/v3/users/02f68dbf575c4ed9ba1c3ff8c6b99656 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:33.955539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:33.956302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:33.956869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:33.957830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5b220653f346359ab3b421ec96ebcc', 'request_id': 'req-4484c082-916b-449a-8ea6-afee913e05e7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:33.978223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:33.991739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:34.001819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.025891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] The token cache is being invalidate because project 7c5b220653f346359ab3b421ec96ebcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:34.026942 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.028974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4484c082-916b-449a-8ea6-afee913e05e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.047462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 960/1940] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:33 2022] DELETE /identity/v3/projects/7c5b220653f346359ab3b421ec96ebcc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:34.054484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a555829-0c55-4108-8e97-6c5396b796b5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.055520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a555829-0c55-4108-8e97-6c5396b796b5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.055979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a555829-0c55-4108-8e97-6c5396b796b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.109395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a555829-0c55-4108-8e97-6c5396b796b5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:34.112395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a555829-0c55-4108-8e97-6c5396b796b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.169427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 981/1941] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:34.182389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.184599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.273860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 961/1942] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:34.276170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.276423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.277129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.286710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56973-63fa-45b1-b497-cf7084e82374 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.291725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.292385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.292664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.292943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.303348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.304984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.315660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:34.316933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.329456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 962/1943] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:34.330474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.331975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.338369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 982/1944] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:34.343664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.349982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b1f4a-7c8e-45b2-b978-09e2acd95537 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.355807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.356755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.358571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.358571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] PATH_INFO: `/v3/projects/be9e5e930d70494eae2c4712b0c5a227` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.359373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9e5e930d70494eae2c4712b0c5a227)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.361571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.363442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eff589-21f5-45da-86de-1f89434e2b64 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.377908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.378536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.379310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.379583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.380308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:34.380596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.382200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.411877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 983/1945] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:34.416922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.442818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bde8f-617c-4a94-adce-e23280602102 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.450833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9e5e930d70494eae2c4712b0c5a227', 'request_id': 'req-115613f2-70b6-44e3-8cb6-550853d73518'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.473037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9e5e930d70494eae2c4712b0c5a227', 'request_id': 'req-115613f2-70b6-44e3-8cb6-550853d73518'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.497146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9e5e930d70494eae2c4712b0c5a227', 'request_id': 'req-115613f2-70b6-44e3-8cb6-550853d73518'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.521133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] The token cache is being invalidate because project be9e5e930d70494eae2c4712b0c5a227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:34.521871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.524160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-115613f2-70b6-44e3-8cb6-550853d73518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:34.538553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 963/1946] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:34 2022] DELETE /identity/v3/projects/be9e5e930d70494eae2c4712b0c5a227 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:34.544623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd2aa-ff13-424f-bdf9-1cedb8ad0445 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.544922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd2aa-ff13-424f-bdf9-1cedb8ad0445 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.545198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd2aa-ff13-424f-bdf9-1cedb8ad0445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.574454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-976bd2aa-ff13-424f-bdf9-1cedb8ad0445 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:34.576321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-976bd2aa-ff13-424f-bdf9-1cedb8ad0445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.584418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.585051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.585570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.585870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.587024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.588103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 964/1947] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:34.595619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.599033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.599522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.600021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.654648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 984/1948] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:34.655862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.660429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.663307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:34.665350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.714418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:34.743884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:34.783521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228dbec-569c-445d-ae4e-7a744638d27c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.789890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.790773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.791101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.791372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.792222 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.794740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.824063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 965/1949] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:34.828441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.848967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1625b0-5319-4f31-8caf-db25c38d6345 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.858001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 985/1950] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:34.861195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.862209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.863289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.863966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.864269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.864963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:34.865285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.867340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.884486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59112fa-a0a8-440d-925b-a60f3b333f85 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.896019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.897259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.897739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.898193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.899026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.902588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 966/1951] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:34.904622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.905900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.916660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 986/1952] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:34.921792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:34.924105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:34.927974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5729d-19c5-4cb2-b6da-109a12487024 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.934509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.935392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.935750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.936169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.936979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.939682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.953746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb68b66-ad78-4cc9-bbd3-b7a0316c184a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:34.962763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:34.963421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:34.963775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:34.964098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] PATH_INFO: `/v3/projects/2b6bf3a771a5467ea0c4f152c8d03ab4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:34.965391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6bf3a771a5467ea0c4f152c8d03ab4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:34.967544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:34.985754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 967/1953] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:34 2022] POST /identity/v3/projects => generated 359 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:34.988663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.038724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6bf3a771a5467ea0c4f152c8d03ab4', 'request_id': 'req-5f2319ee-4262-4748-814b-ceb3d7a0690b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.048010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6bf3a771a5467ea0c4f152c8d03ab4', 'request_id': 'req-5f2319ee-4262-4748-814b-ceb3d7a0690b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.056164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6bf3a771a5467ea0c4f152c8d03ab4', 'request_id': 'req-5f2319ee-4262-4748-814b-ceb3d7a0690b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.070628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] The token cache is being invalidate because project 2b6bf3a771a5467ea0c4f152c8d03ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:35.071232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.072196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.074211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 987/1954] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:34 2022] DELETE /identity/v3/projects/2b6bf3a771a5467ea0c4f152c8d03ab4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:35.076862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.078877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.093649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3143-d7f1-4b9d-afe6-264304aa10c6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.223657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.224473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.225447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2319ee-4262-4748-814b-ceb3d7a0690b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.225816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.226198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.229793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.231613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.231757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.232279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.232561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.232836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.234359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.236610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.248557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 968/1955] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:35.248557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.248955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.266594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573dd92-07b4-4070-82c3-55017e239271 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.273151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.274542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.274542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.274822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] PATH_INFO: `/v3/users/f27f516fda994928974fd9e07448a0c6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.276606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27f516fda994928974fd9e07448a0c6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.279633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.289206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 988/1956] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:35 2022] POST /identity/v3/users => generated 280 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:35.289206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.298034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.318572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2184ff1-97a2-4764-9bd8-3d78ade45b0b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.324122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.324980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.325283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.325560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] PATH_INFO: `/v3/projects/fb131f93d0164668a9d3eb31de5f18ca/users/978bda2207044144a800af9492ccd13b/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.336341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:35.344126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:35.351738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb131f93d0164668a9d3eb31de5f18ca, user_id=978bda2207044144a800af9492ccd13b, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.355255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27f516fda994928974fd9e07448a0c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.355617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.366050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27f516fda994928974fd9e07448a0c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.367065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27f516fda994928974fd9e07448a0c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.376237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27f516fda994928974fd9e07448a0c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.377273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d33aec28-d277-42c9-a445-e93dea11a772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27f516fda994928974fd9e07448a0c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:35.387167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 989/1957] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:35 2022] PUT /identity/v3/projects/fb131f93d0164668a9d3eb31de5f18ca/users/978bda2207044144a800af9492ccd13b/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:35.387167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.387167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.411460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 969/1958] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:35 2022] DELETE /identity/v3/users/f27f516fda994928974fd9e07448a0c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:35.413958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.414441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.415427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.457982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] MFA Rules not processed for user `978bda2207044144a800af9492ccd13b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:35.459843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.512040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310d39d-abce-4a85-91a2-7a2027a181e8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.575974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 970/1959] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:35.581029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.585743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.670585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.674565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.674856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.675129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.677064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.683208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.713393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 990/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:35.717331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.740702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4352ed-e596-47bf-aead-7855b742718e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.741148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4357d3-342b-4017-b866-2cc7004ecbf8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.747102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.748204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.748543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.748860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.749651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.749651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.750001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.750139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.750712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.751994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.753004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.754502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.769272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 991/1961] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:35.770442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.795961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2105-5c6a-4f30-aa41-ca59af00b2ca admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:35.802539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:35.803297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:35.803604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:35.807096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] PATH_INFO: `/v3/projects/f5cb121396e64af8bfe274d95908f91d/users/68176e6361f14b7abb24a2aa7fc0aa08/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:35.834951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 971/1962] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:35 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:35.834951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.836780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:35.867063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cb121396e64af8bfe274d95908f91d, user_id=68176e6361f14b7abb24a2aa7fc0aa08, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:35.871651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:35.894472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:35.899992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 992/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:35 2022] PUT /identity/v3/projects/f5cb121396e64af8bfe274d95908f91d/users/68176e6361f14b7abb24a2aa7fc0aa08/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:35.900469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:35.959425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3aed-fc02-4f6c-88ca-d6c122c9ce0c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.055482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:36.063263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664eae5-1da6-4351-aa96-942ee8bac478 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.077050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfcb07-3ba5-4812-9080-67591de09140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.078223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfcb07-3ba5-4812-9080-67591de09140 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.079207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.079700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfcb07-3ba5-4812-9080-67591de09140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.079984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfcb07-3ba5-4812-9080-67591de09140 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.080962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.081231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.081495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] PATH_INFO: `/v3/projects/0736410d88fc4e9eb6413b41988bb332` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.081840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfcb07-3ba5-4812-9080-67591de09140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.086132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0736410d88fc4e9eb6413b41988bb332)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.086676 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfcb07-3ba5-4812-9080-67591de09140 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.089728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.138181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 993/1964] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:35 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:36.140336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.140616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.140885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.171809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] MFA Rules not processed for user `68176e6361f14b7abb24a2aa7fc0aa08`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:36.173143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.248704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0736410d88fc4e9eb6413b41988bb332', 'request_id': 'req-e25a5f45-b337-4885-8fd1-fbe4c705e620'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.265188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0736410d88fc4e9eb6413b41988bb332', 'request_id': 'req-e25a5f45-b337-4885-8fd1-fbe4c705e620'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.281297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0736410d88fc4e9eb6413b41988bb332', 'request_id': 'req-e25a5f45-b337-4885-8fd1-fbe4c705e620'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.281763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 994/1965] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:36.283136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.309794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] The token cache is being invalidate because project 0736410d88fc4e9eb6413b41988bb332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:36.310273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.314723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e25a5f45-b337-4885-8fd1-fbe4c705e620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.323636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 972/1966] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:35 2022] DELETE /identity/v3/projects/0736410d88fc4e9eb6413b41988bb332 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:36.325689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.325689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.325689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.335194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2e323-80e2-4f66-a247-1b1748c76a7c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.390272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:36.392335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.470207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.470829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.471107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.471383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.472044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.473638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.481480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 973/1967] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:36.482349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.483743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.485486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 995/1968] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:36.486654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.489540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.494514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:36.505745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced2f7a-168c-4a2f-91f6-05440df76898 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.512274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.513028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.517348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.517348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] PATH_INFO: `/v3/users/7dc62741d8fa40ae85d477c8e6888348` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.519657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc62741d8fa40ae85d477c8e6888348)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.522459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.555739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1628e-6428-4b34-ac7c-043303e74f1b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.564265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.564994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.565330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.565597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.567463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.598088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc62741d8fa40ae85d477c8e6888348'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.599858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc62741d8fa40ae85d477c8e6888348'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.608768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc62741d8fa40ae85d477c8e6888348'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.609606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc62741d8fa40ae85d477c8e6888348'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.619280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-18b32858-ef79-41ec-a875-c1a4454e89f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc62741d8fa40ae85d477c8e6888348'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.625841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:36.641117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.642611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.647386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 996/1969] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:36 2022] DELETE /identity/v3/users/7dc62741d8fa40ae85d477c8e6888348 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:36.649904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c04c9d-db69-4bfa-817e-ac2b466910a1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.650236 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c04c9d-db69-4bfa-817e-ac2b466910a1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.650533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c04c9d-db69-4bfa-817e-ac2b466910a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.654571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 974/1970] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:36.654571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.655840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.677711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfaca3-a86d-4d76-a20b-e8d3def6ffb5 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.680470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-09c04c9d-db69-4bfa-817e-ac2b466910a1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:36.681675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-09c04c9d-db69-4bfa-817e-ac2b466910a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.755558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.756527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.756912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.757286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] PATH_INFO: `/v3/projects/0e40bad1a28841dea6538483551bd41a/users/78479adfbe144f4c9dd3c51e05b54b96/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.758182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 997/1971] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:36.759589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.760024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.760303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.779380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e40bad1a28841dea6538483551bd41a, user_id=78479adfbe144f4c9dd3c51e05b54b96, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.782916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.783029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:36.784463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.794087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 998/1972] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:36.795110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.798528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.811013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 975/1973] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:36 2022] PUT /identity/v3/projects/0e40bad1a28841dea6538483551bd41a/users/78479adfbe144f4c9dd3c51e05b54b96/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:36.811013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.815230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7793-134a-433a-97a2-0652108e9b93 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.872061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:36.894509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af73c-f6e8-486e-9cf6-27d73fedb084 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:36.899696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.899850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:36.900510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.901009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.901323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] PATH_INFO: `/v3/users/68176e6361f14b7abb24a2aa7fc0aa08` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.902064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:36.902324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68176e6361f14b7abb24a2aa7fc0aa08)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.902424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:36.902669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:36.903246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:36.903546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:36.904383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.905910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:36.949820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 976/1974] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:36.951340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:36.953431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:36.969278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68176e6361f14b7abb24a2aa7fc0aa08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.971646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68176e6361f14b7abb24a2aa7fc0aa08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.982347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68176e6361f14b7abb24a2aa7fc0aa08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.983738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68176e6361f14b7abb24a2aa7fc0aa08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:36.993251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68176e6361f14b7abb24a2aa7fc0aa08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:37.009825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:37.021621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 999/1975] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:36 2022] DELETE /identity/v3/users/68176e6361f14b7abb24a2aa7fc0aa08 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:37.021621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.021975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.033012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a27a-96f0-4722-a1ff-66d33f85e382 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.128378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.129324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.129804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.130406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.132716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.146759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd930bb-24de-4e35-987e-935d254ad7e6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.152499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.153823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff49b-fa6b-4948-bb0e-54b1a178cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.154449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff49b-fa6b-4948-bb0e-54b1a178cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.154609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.154706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff49b-fa6b-4948-bb0e-54b1a178cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.155498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff49b-fa6b-4948-bb0e-54b1a178cb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.156183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ff49b-fa6b-4948-bb0e-54b1a178cb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.157771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ff49b-fa6b-4948-bb0e-54b1a178cb4e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.169922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 977/1976] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:37.171428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.173037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.187334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc159c-190f-434b-b7cf-f73d09295109 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.194850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.195708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.195887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1000/1977] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:37.196387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.197027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.197310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.197599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.197874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.198496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.200702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.247851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 978/1978] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:37 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:37.249599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.259966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:37.261843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.360978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ea46-7f9a-4fda-95dc-34706a516ad8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.369832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b5170-93dd-4b89-9ce5-bf019bdb3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.370959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5170-93dd-4b89-9ce5-bf019bdb3cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.371474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5170-93dd-4b89-9ce5-bf019bdb3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.372487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5170-93dd-4b89-9ce5-bf019bdb3cca admin admin] PATH_INFO: `/v3/projects/0e40bad1a28841dea6538483551bd41a/users/78479adfbe144f4c9dd3c51e05b54b96/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.376245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b5170-93dd-4b89-9ce5-bf019bdb3cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e40bad1a28841dea6538483551bd41a, user_id=78479adfbe144f4c9dd3c51e05b54b96, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.380101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b5170-93dd-4b89-9ce5-bf019bdb3cca admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.385175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1001/1979] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:37.386770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.397844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 979/1980] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:37 2022] PUT /identity/v3/projects/0e40bad1a28841dea6538483551bd41a/users/78479adfbe144f4c9dd3c51e05b54b96/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:37.406159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4de17-fbbe-40e0-b291-e031e7442998 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.409581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.410141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.411628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.444425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:37.487071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] MFA Rules not processed for user `78479adfbe144f4c9dd3c51e05b54b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:37.490074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.527457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.528210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.528491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.528870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.529560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.532083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.565489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1002/1981] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:37 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:37.567117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.569713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.624720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:37.640859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 980/1982] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:37.655014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.670009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78873093-b370-4ca8-9a67-5502e8e42bef None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.673804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc4a01-6efd-44b9-8d18-6abe7cd3b86a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.675478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.675696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.676298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.676526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.676644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.676723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.676898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.677023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.677688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.679541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.690549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.692030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.693002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 981/1983] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:37.693937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.702707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.730978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1003/1984] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:37.731863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.733340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.752605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394874-5cfd-4a21-be83-d4a464ee48c6 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.760151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.761071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.761345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.761616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] PATH_INFO: `/v3/projects/b17fe18c213643a0b820d5595264e664` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.762980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17fe18c213643a0b820d5595264e664)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.765167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.820940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe2b0d-ee4a-469e-a36b-703a4b2a3b41 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.848637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17fe18c213643a0b820d5595264e664', 'request_id': 'req-5527a203-d841-449d-b9fb-d47757d9d72c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:37.860271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17fe18c213643a0b820d5595264e664', 'request_id': 'req-5527a203-d841-449d-b9fb-d47757d9d72c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:37.871375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17fe18c213643a0b820d5595264e664', 'request_id': 'req-5527a203-d841-449d-b9fb-d47757d9d72c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:37.887055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] The token cache is being invalidate because project b17fe18c213643a0b820d5595264e664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:37.887343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:37.888368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:37.890834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1004/1985] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:37 2022] DELETE /identity/v3/projects/b17fe18c213643a0b820d5595264e664 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:37.891780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.893931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.894878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.895699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.896013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.896290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.898331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:37.965095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:37.981865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527a203-d841-449d-b9fb-d47757d9d72c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:37.982727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.984954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.987741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:37.988425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:37.988703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:37.990038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:37.990703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:37.993750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:37.996983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 982/1986] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:37.997979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:37.999600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.015998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961872d-f059-4144-8ce5-7b003bac6ce7 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:38.022935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:38.023596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:38.023872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:38.024179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] PATH_INFO: `/v3/users/93a5c99d6eb2455993560a77b1fdaa3c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:38.025480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a5c99d6eb2455993560a77b1fdaa3c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:38.027413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:38.035465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1005/1987] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:38.040823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:38.065431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed7335-1bdf-45e4-8f4a-dfdbe4924284 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:38.071811 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dd34f-03bf-4d68-b42d-94e88c823732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:38.072523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd34f-03bf-4d68-b42d-94e88c823732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:38.072802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd34f-03bf-4d68-b42d-94e88c823732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:38.073073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd34f-03bf-4d68-b42d-94e88c823732 admin admin] PATH_INFO: `/v3/projects/bb5a37fbdc80434d881af75db74f1385/users/41b6592ae2e74709a0a571d96bf2b9ef/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:38.091570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dd34f-03bf-4d68-b42d-94e88c823732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5a37fbdc80434d881af75db74f1385, user_id=41b6592ae2e74709a0a571d96bf2b9ef, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:38.095340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dd34f-03bf-4d68-b42d-94e88c823732 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:38.112266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1006/1988] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:38 2022] PUT /identity/v3/projects/bb5a37fbdc80434d881af75db74f1385/users/41b6592ae2e74709a0a571d96bf2b9ef/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:38.123908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:38.124219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:38.124746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:38.136184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a5c99d6eb2455993560a77b1fdaa3c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:38.146577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a5c99d6eb2455993560a77b1fdaa3c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:38.147928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a5c99d6eb2455993560a77b1fdaa3c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:38.159791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a5c99d6eb2455993560a77b1fdaa3c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:38.160010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] MFA Rules not processed for user `41b6592ae2e74709a0a571d96bf2b9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:38.160909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a5c99d6eb2455993560a77b1fdaa3c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:38.161426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.172471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:38.199979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 983/1989] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:37 2022] DELETE /identity/v3/users/93a5c99d6eb2455993560a77b1fdaa3c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:38.200958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:38.203726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.332316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efc70a-9aa5-4e3d-a994-24f7cdb8b4f5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:38.340185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1007/1990] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:38.354086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:38.354739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:38.355028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:38.355302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:38.356646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:38.358494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.363022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.494562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:38.497882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:38.527691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4a224-ad1e-4492-a87e-b81ebec21ed0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:38.534453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 984/1991] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:38.696761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:38.697387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:38.697666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:38.697938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:38.700226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:38.702684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.722761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:38.820384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:38.822221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:38.861419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1008/1992] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:38.910745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c55be7-9500-45d0-8cc0-c8d22e5674fb service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:38.917909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:38.918633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:38.918909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:38.919436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] PATH_INFO: `/v3/projects/f5cb121396e64af8bfe274d95908f91d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:38.921001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cb121396e64af8bfe274d95908f91d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:38.922845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:38.927432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:38.929870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:38.955230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:38.979532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f094d0-278c-4dae-bd53-e4115c3f3e2a service glance] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:38.998377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cb121396e64af8bfe274d95908f91d', 'request_id': 'req-94bc71ca-f05c-491f-bce6-36118af14414'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.035050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cb121396e64af8bfe274d95908f91d', 'request_id': 'req-94bc71ca-f05c-491f-bce6-36118af14414'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.067424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cb121396e64af8bfe274d95908f91d', 'request_id': 'req-94bc71ca-f05c-491f-bce6-36118af14414'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.101341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] The token cache is being invalidate because project f5cb121396e64af8bfe274d95908f91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:39.101513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.104303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94bc71ca-f05c-491f-bce6-36118af14414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.108763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 985/1993] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:38 2022] DELETE /identity/v3/projects/f5cb121396e64af8bfe274d95908f91d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:39.113296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5364b-e27d-441d-9a6b-2e781302631c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.114012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5364b-e27d-441d-9a6b-2e781302631c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.114363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5364b-e27d-441d-9a6b-2e781302631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.141732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.143412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.143843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.144291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] PATH_INFO: `/v3/projects/04c170e97f494d66a3bcf07350a73ec1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.146558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c170e97f494d66a3bcf07350a73ec1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.149486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:39.161357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-92c5364b-e27d-441d-9a6b-2e781302631c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:39.162910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-92c5364b-e27d-441d-9a6b-2e781302631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:39.175214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 986/1994] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:39.186621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.186621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.187862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.265728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c170e97f494d66a3bcf07350a73ec1', 'request_id': 'req-443c6199-fe04-4f6c-be87-2d757dc6e071'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.273575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:39.279253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:39.286405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c170e97f494d66a3bcf07350a73ec1', 'request_id': 'req-443c6199-fe04-4f6c-be87-2d757dc6e071'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.305211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c170e97f494d66a3bcf07350a73ec1', 'request_id': 'req-443c6199-fe04-4f6c-be87-2d757dc6e071'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.350852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] The token cache is being invalidate because project 04c170e97f494d66a3bcf07350a73ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:39.351478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.353314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-443c6199-fe04-4f6c-be87-2d757dc6e071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:39.356347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1009/1995] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:38 2022] DELETE /identity/v3/projects/04c170e97f494d66a3bcf07350a73ec1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:39.361410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.361922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.362370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.441969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:39.443464 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:39.474021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 987/1996] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:39.475116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.479880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:39.561608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1010/1997] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:39.563005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.570699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:39.579330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90f7d2-8e85-4aa4-bcec-dd96be8bbe01 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:39.586443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.587209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.587463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.587794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.588652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:39.589005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.591252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a7c06-8fbf-4a98-a253-265aa9065ccb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:39.596521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023454c-1563-4525-91e4-5c7b7c240671 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:39.603666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.604775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.604775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.604948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.606193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1011/1998] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:39.608008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:39.611764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.612105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.612471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.654159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:39.655519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:39.668381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1012/1999] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:39.669747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.689249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069714f-c2d3-4220-acba-1be9bbb60c1d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:39.695144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.695919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.696231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.696508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.701760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.709470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:39.734907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:39.738393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.740276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:39.759388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 988/2000] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:39.760331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.777709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1013/2001] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:39.782004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.789218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356a8bd-1e76-44e0-b016-781cfc43924c service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:39.908243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5361-79f3-4f6f-9588-8c0e9fb6f07e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:39.910176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.911113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.911665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.911770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.912718 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:39.913094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.915624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.918186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.918748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.919275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.920412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:39.921175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.923388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:39.959461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 989/2002] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:39.959461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.960001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1014/2003] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:39.968885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345b30-61ca-41a7-b909-55b8607dd77a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:39.974140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:39.974789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:39.975090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:39.975373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:39.975523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:39.976115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:39.978225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.018027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 990/2004] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:39 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:40.019120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6c3ac-f40c-4530-8e1c-48a20e1b5927 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.022516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.109466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.111714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.112053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.112339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.113023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.115862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.137865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1015/2005] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:40.137865 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.139129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.163093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d20af9-db09-45eb-bedf-ecd9b23b2e31 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.165451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ad25-f8b6-4a1b-966b-c290cc222fe1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.169397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.170318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.171221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.171564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] PATH_INFO: `/v3/users/978bda2207044144a800af9492ccd13b` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.172617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.173268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] RBAC: Authorizing `identity:delete_user(user_id=978bda2207044144a800af9492ccd13b)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.173706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.174176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.174647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.175489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.175608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.183100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.198819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:40.222235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 991/2006] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:40 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:40.223060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.238844 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d1476-9868-407a-8c26-48a4cde27726 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.251704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.256139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.256139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.256139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.256139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.258919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.277385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 992/2007] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:40.282095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.286799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978bda2207044144a800af9492ccd13b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:40.290706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978bda2207044144a800af9492ccd13b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:40.294930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87987b2a-3415-474e-a80d-565931d4e94b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.301058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.302038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.302198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.302449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.303109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.305011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.305128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978bda2207044144a800af9492ccd13b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:40.305841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978bda2207044144a800af9492ccd13b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:40.319069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978bda2207044144a800af9492ccd13b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:40.332813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:40.336865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 993/2008] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:40.339232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.343369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.375073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0db93-8b28-466c-8bf3-a6a56ed55474 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.393136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1016/2009] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:40 2022] DELETE /identity/v3/users/978bda2207044144a800af9492ccd13b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:40.394629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.401595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.495852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9d85-b72f-4e6d-98ba-8582499e850a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.502238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab78fbf-5604-4e37-9f3d-9e54ac05ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.503163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab78fbf-5604-4e37-9f3d-9e54ac05ba65 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.503562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab78fbf-5604-4e37-9f3d-9e54ac05ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.504221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab78fbf-5604-4e37-9f3d-9e54ac05ba65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.505097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab78fbf-5604-4e37-9f3d-9e54ac05ba65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.507991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab78fbf-5604-4e37-9f3d-9e54ac05ba65 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.539278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1017/2010] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:40.539278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.539278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.539278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.539729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.539729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.539729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.539729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] PATH_INFO: `/v3/projects/088beea307b24c55932f2eaa9062ca61/users/3b08cbf85f0c453da63af318b1d3909e/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.553701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:40.554962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.576080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1018/2011] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:40.577352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088beea307b24c55932f2eaa9062ca61, user_id=3b08cbf85f0c453da63af318b1d3909e, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.577469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.580492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.599063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f5b77-5186-427d-9aad-e12619ebffa2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.607518 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 994/2012] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:40 2022] PUT /identity/v3/projects/088beea307b24c55932f2eaa9062ca61/users/3b08cbf85f0c453da63af318b1d3909e/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:40.608630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:40.624039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.769902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ed4a2-9a44-456e-8fa4-eb463a3d542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.770848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ed4a2-9a44-456e-8fa4-eb463a3d542d admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.771349 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ed4a2-9a44-456e-8fa4-eb463a3d542d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.771836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ed4a2-9a44-456e-8fa4-eb463a3d542d admin admin] PATH_INFO: `/v3/projects/71bfc5788f3940a68607ae375ace6d2f/users/ce1b0a9edb7d4dfb8abfca1b61ba85ab/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.795409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ed4a2-9a44-456e-8fa4-eb463a3d542d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bfc5788f3940a68607ae375ace6d2f, user_id=ce1b0a9edb7d4dfb8abfca1b61ba85ab, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.797774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44cfc7-20a3-43e8-be59-a3f50ac288e6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:40.798911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ed4a2-9a44-456e-8fa4-eb463a3d542d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.802686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46e562-0dfc-4e96-afd6-5efe11a8ea11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:40.803314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e562-0dfc-4e96-afd6-5efe11a8ea11 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.803598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e562-0dfc-4e96-afd6-5efe11a8ea11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.803873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e562-0dfc-4e96-afd6-5efe11a8ea11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.819871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46e562-0dfc-4e96-afd6-5efe11a8ea11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:40.821772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46e562-0dfc-4e96-afd6-5efe11a8ea11 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:40.847446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1019/2013] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:40 2022] PUT /identity/v3/projects/71bfc5788f3940a68607ae375ace6d2f/users/ce1b0a9edb7d4dfb8abfca1b61ba85ab/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:40.847446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.847446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.847446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.848057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 995/2014] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:40.849260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:40.849554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:40.849832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:40.891385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] MFA Rules not processed for user `ce1b0a9edb7d4dfb8abfca1b61ba85ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:40.892697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.932382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] MFA Rules not processed for user `3b08cbf85f0c453da63af318b1d3909e`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:40.936806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:40.968307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:41.027293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 996/2015] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:41.033547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.066583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:41.103055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1020/2016] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:41.107674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.145093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5748d-ac32-48b8-97ad-d9c6d0e68294 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.150277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.150907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.151229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.151512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.152201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.154379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.209128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec7015-3b9a-4640-8b37-a69312323a26 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.211362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 997/2017] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:41 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:41.215981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.304123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7dd17-a53b-499c-8ca4-ca77e8a1692b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.306321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.306937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.307218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.307490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.308166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.310434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.314745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.315497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.315870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.316177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.316811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.319055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.357721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1021/2018] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:41 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:41.359174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.360732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.363999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 998/2019] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:41 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:41.365060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.377368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128108-24a0-45ef-8a9b-6b735c07b009 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.430877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:41.433988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b65ec9-be22-4a93-9706-ce23a26ba1e7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.439297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.439466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.439927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.440118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.440229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.440398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.440499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.440671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] PATH_INFO: `/v3/projects/fb131f93d0164668a9d3eb31de5f18ca` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.441122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.441826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb131f93d0164668a9d3eb31de5f18ca)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.443256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.443712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.472277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 999/2020] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:41 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:41.472277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.482614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0a9e-04fe-495b-aada-32e42de1de0f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.483796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:41.488696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.489362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.489596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.489918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.490614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.492256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.501403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb131f93d0164668a9d3eb31de5f18ca', 'request_id': 'req-ba0020a6-535e-4d63-a540-6c9550ce38e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.503306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1000/2021] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:41.504176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.512470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb131f93d0164668a9d3eb31de5f18ca', 'request_id': 'req-ba0020a6-535e-4d63-a540-6c9550ce38e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.514573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc8f9-13f8-4688-ae88-10b1d6353a5c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.519045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb131f93d0164668a9d3eb31de5f18ca', 'request_id': 'req-ba0020a6-535e-4d63-a540-6c9550ce38e6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.529575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] The token cache is being invalidate because project fb131f93d0164668a9d3eb31de5f18ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:41.530469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.531053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.532577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1022/2022] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:41 2022] DELETE /identity/v3/projects/fb131f93d0164668a9d3eb31de5f18ca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:41.533310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.534564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.573369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.573984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.574261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.574530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.575283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.576985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.587076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1001/2023] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:41.587969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.589772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.601164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0020a6-535e-4d63-a540-6c9550ce38e6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.603631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0c931-7026-476b-a00c-88950f38ac08 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.605859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.606527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.606810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.607086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] PATH_INFO: `/v3/projects/4562e542ae3d445aa0ebed8cf6b6e49a/users/4f9573f7c6be481fae30a6d8074a8a97/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.608554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.609210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.609697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.609976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] PATH_INFO: `/v3/users/78479adfbe144f4c9dd3c51e05b54b96` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.612047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78479adfbe144f4c9dd3c51e05b54b96)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.613971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.622148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4562e542ae3d445aa0ebed8cf6b6e49a, user_id=4f9573f7c6be481fae30a6d8074a8a97, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.625485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.639874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1023/2024] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:41 2022] PUT /identity/v3/projects/4562e542ae3d445aa0ebed8cf6b6e49a/users/4f9573f7c6be481fae30a6d8074a8a97/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:41.640780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.642634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.672460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78479adfbe144f4c9dd3c51e05b54b96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.680300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78479adfbe144f4c9dd3c51e05b54b96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.681199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78479adfbe144f4c9dd3c51e05b54b96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.689920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78479adfbe144f4c9dd3c51e05b54b96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.690810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78479adfbe144f4c9dd3c51e05b54b96'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:41.708807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1002/2025] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:41 2022] DELETE /identity/v3/users/78479adfbe144f4c9dd3c51e05b54b96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:41.709790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.711276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.711457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55765f37-9adb-4f82-bb53-acc050deb78e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.759350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:41.773462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:41.786026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.786901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.787336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.787720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.788527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.790309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.806034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1024/2026] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:41.816073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.816307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b45ce-5b3e-417c-8371-19ff1a3095d7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.816405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.820954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.821664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.822679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.823030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.828084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.828084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.834543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e29ba7-c4ba-4dd2-8f62-b876f1816ce6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.840051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e018613-5838-463d-95f9-0c9471684dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.840907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e018613-5838-463d-95f9-0c9471684dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.841189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e018613-5838-463d-95f9-0c9471684dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.841293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1003/2027] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:41.841428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e018613-5838-463d-95f9-0c9471684dcf admin admin] PATH_INFO: `/v3/projects/d202d7200a434c90b6d2f928b5d9be60/users/7b875ad1be984b2392afe24a6d7d6e18/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.848360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:41.864100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520f76f-840e-458b-bb5a-ed59ad3a9b52 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:41.873231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e018613-5838-463d-95f9-0c9471684dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d202d7200a434c90b6d2f928b5d9be60, user_id=7b875ad1be984b2392afe24a6d7d6e18, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.876287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e018613-5838-463d-95f9-0c9471684dcf admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.876586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72a522-1fd7-41cd-8f7c-1d50741f76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:41.877378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72a522-1fd7-41cd-8f7c-1d50741f76be admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.877720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72a522-1fd7-41cd-8f7c-1d50741f76be admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.878052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72a522-1fd7-41cd-8f7c-1d50741f76be admin admin] PATH_INFO: `/v3/projects/4562e542ae3d445aa0ebed8cf6b6e49a/users/4f9573f7c6be481fae30a6d8074a8a97/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.880290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72a522-1fd7-41cd-8f7c-1d50741f76be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4562e542ae3d445aa0ebed8cf6b6e49a, user_id=4f9573f7c6be481fae30a6d8074a8a97, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:41.883611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72a522-1fd7-41cd-8f7c-1d50741f76be admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:41.892328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1025/2028] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:41 2022] PUT /identity/v3/projects/d202d7200a434c90b6d2f928b5d9be60/users/7b875ad1be984b2392afe24a6d7d6e18/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:41.905268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.906059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.906059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.909402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1004/2029] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:41 2022] PUT /identity/v3/projects/4562e542ae3d445aa0ebed8cf6b6e49a/users/4f9573f7c6be481fae30a6d8074a8a97/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:41.921435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:41.921863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:41.922348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:41.941360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] MFA Rules not processed for user `7b875ad1be984b2392afe24a6d7d6e18`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:41.944157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:41.957129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] MFA Rules not processed for user `4f9573f7c6be481fae30a6d8074a8a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:41.959173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.029616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1026/2030] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:42.034551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.066619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1005/2031] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:42.066619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.068165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.105952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8de5ed-76f7-48d3-9190-78158dbd9497 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.110736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.111408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.111750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.112116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.112813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.114822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.143062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d7f7a-530c-4176-b677-ba77b4852329 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.144731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1027/2032] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:42.148672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.150269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.183974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:42.200120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.200682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.200957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.201226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] PATH_INFO: `/v3/projects/0e40bad1a28841dea6538483551bd41a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.202364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e40bad1a28841dea6538483551bd41a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.204293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.205784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:42.208484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3f70e-55a5-48e8-8f83-0ffac2b2b3e2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.212115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.212752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.212982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.213223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.255163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e40bad1a28841dea6538483551bd41a', 'request_id': 'req-59051986-1af9-400a-ad93-a6c562516712'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:42.261660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e40bad1a28841dea6538483551bd41a', 'request_id': 'req-59051986-1af9-400a-ad93-a6c562516712'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:42.270697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e40bad1a28841dea6538483551bd41a', 'request_id': 'req-59051986-1af9-400a-ad93-a6c562516712'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:42.284876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.284876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.290140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] The token cache is being invalidate because project 0e40bad1a28841dea6538483551bd41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:42.290695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:42.291675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-59051986-1af9-400a-ad93-a6c562516712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:42.296836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1028/2034] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:42.297709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.298145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1006/2034] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:42 2022] DELETE /identity/v3/projects/0e40bad1a28841dea6538483551bd41a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:42.299591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.299875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.300192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.310762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b93bac-9e7c-4bd2-b427-f46754547809 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.332000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:42.338754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.401886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf0d45-9101-48b9-99d8-d6584b4becf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.402505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0d45-9101-48b9-99d8-d6584b4becf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.402788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0d45-9101-48b9-99d8-d6584b4becf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.403149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf0d45-9101-48b9-99d8-d6584b4becf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.403912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf0d45-9101-48b9-99d8-d6584b4becf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.408220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf0d45-9101-48b9-99d8-d6584b4becf3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.414734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1007/2035] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:42.415840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.417391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.439183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1029/2036] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:42.441117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.441700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.442158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.467036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:42.469230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.480145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1030/2037] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:42.481346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.483108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.496331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75cf0-c12c-4978-8b87-e172c800c2aa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.500225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271fae7-5a78-4789-ac72-d4e057626463 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.502247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.503332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.503800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.504310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.504520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.505039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.505315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.505609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.506279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.507861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.508104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.524271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1031/2038] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:42.525078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.535730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5de646-b4e3-4035-837d-f277da958814 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.540646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.541948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.542227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.542497 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.543144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:42.543447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.546171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.559121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1032/2039] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:42.563203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.568886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:42.575550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb50789-2e2f-4453-8fd1-b8ad439b1cfe admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.581286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.581895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.582260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.582565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] PATH_INFO: `/v3/projects/139a85cfdc1d43d081b8c26be90d0c1f/users/c4fe36ff43b94ba88defa4d53e3c0c4b/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.596523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.598747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.616229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1008/2040] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:42.617081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.628673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139a85cfdc1d43d081b8c26be90d0c1f, user_id=c4fe36ff43b94ba88defa4d53e3c0c4b, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.631807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.645608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0701-698f-40b5-ab85-1480232f7070 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.661088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1033/2041] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:42 2022] PUT /identity/v3/projects/139a85cfdc1d43d081b8c26be90d0c1f/users/c4fe36ff43b94ba88defa4d53e3c0c4b/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:42.665688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.710788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:42.733339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.733968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.734387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.734687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.735771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.738362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.774153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9e12-2d85-4b23-b954-83823ad3e0a3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.778572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1009/2042] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:42.784258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.784838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.785660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.786019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.786330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.787121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.789204 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.803787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1034/2043] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:42.812873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.826318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184376e-38a9-43a9-8132-860a1d5b659e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.862487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a232-bc8c-4d66-886d-7d424818ab25 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.867666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.868326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.868605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.868986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.869615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.871528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.892916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbc93b-8a5b-4970-9f66-e28aa7a84b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:42.893663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbc93b-8a5b-4970-9f66-e28aa7a84b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.894004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbc93b-8a5b-4970-9f66-e28aa7a84b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.894344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbc93b-8a5b-4970-9f66-e28aa7a84b54 admin admin] PATH_INFO: `/v3/projects/139a85cfdc1d43d081b8c26be90d0c1f/users/c4fe36ff43b94ba88defa4d53e3c0c4b/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.896356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbc93b-8a5b-4970-9f66-e28aa7a84b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139a85cfdc1d43d081b8c26be90d0c1f, user_id=c4fe36ff43b94ba88defa4d53e3c0c4b, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:42.899808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1010/2044] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:42.899960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbc93b-8a5b-4970-9f66-e28aa7a84b54 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:42.901638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:42.912220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1035/2045] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:42 2022] PUT /identity/v3/projects/139a85cfdc1d43d081b8c26be90d0c1f/users/c4fe36ff43b94ba88defa4d53e3c0c4b/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:42.915550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621bf6-5071-4f8e-a69c-b4ff3f16d654 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:42.923256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:42.923926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:42.923926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:42.952936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] MFA Rules not processed for user `c4fe36ff43b94ba88defa4d53e3c0c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:42.954150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:42.999616 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.000310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.000585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.000852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.001496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.004206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.005856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:43.020031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1011/2046] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:43.023858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.036101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b201418-5f8d-4097-82cd-20fb1c8b46aa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.041944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.042557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.042834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.043098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.044170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.046159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.065515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1036/2047] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:43.066762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.068506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:43.082129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1012/2048] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:43.087247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.098405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecbb97-1931-4739-8f3d-4600e4667c14 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.103347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e43889-4794-41d0-801c-16baafae9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.104133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e43889-4794-41d0-801c-16baafae9f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.104476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e43889-4794-41d0-801c-16baafae9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.104818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e43889-4794-41d0-801c-16baafae9f8f admin admin] PATH_INFO: `/v3/projects/890c55959ca344c29c5cfac0cae7fb53/users/c85c030e2ca74dff9368cf711ccc929b/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.106891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:43.123665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e43889-4794-41d0-801c-16baafae9f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=890c55959ca344c29c5cfac0cae7fb53, user_id=c85c030e2ca74dff9368cf711ccc929b, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.126494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e43889-4794-41d0-801c-16baafae9f8f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.140390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6c790-9c44-424a-b3ea-480027ddf152 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.142938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1013/2049] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:43 2022] PUT /identity/v3/projects/890c55959ca344c29c5cfac0cae7fb53/users/c85c030e2ca74dff9368cf711ccc929b/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:43.153906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.154177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.154449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.184013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] MFA Rules not processed for user `c85c030e2ca74dff9368cf711ccc929b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:43.185985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:43.193911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.194521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.194796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.195067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.196812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:43.255230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1014/2050] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:43.256248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.258084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.259537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.269734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1037/2051] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:43.332771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad2b3-6f56-4170-857a-d54ff3e9c862 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.337741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.338436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.338889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.339154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.339805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.341753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.372182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1015/2052] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:43 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:43.376884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.387629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369b5e-4492-49ea-826a-7d7164dc515f service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.451043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.452008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.452467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.452890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.453917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.456708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.486984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1038/2053] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:43 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:43.488119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.502145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807196d8-4a69-4f0d-bd00-d1d56d6f849d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.508894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.510326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.510912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.511195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.512245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.528519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.562530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1016/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:43.566423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.595055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239ced-94f3-4c77-8b13-80555489cae8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.610738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.611315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.611602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.611881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] PATH_INFO: `/v3/projects/ec7db35ea42c4354b72ae92e446700f5/users/4cd75d597c254acf9cfd152435fced05/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.632861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7db35ea42c4354b72ae92e446700f5, user_id=4cd75d597c254acf9cfd152435fced05, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.650237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.678071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1039/2055] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:43 2022] PUT /identity/v3/projects/ec7db35ea42c4354b72ae92e446700f5/users/4cd75d597c254acf9cfd152435fced05/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:43.678894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.699309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4e77e-8449-4517-a6b2-176bcd63e40e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.725207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:43.770096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4d5e0-8d48-4108-bfd5-d7fd3a848f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.770714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d5e0-8d48-4108-bfd5-d7fd3a848f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.770986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d5e0-8d48-4108-bfd5-d7fd3a848f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.771255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d5e0-8d48-4108-bfd5-d7fd3a848f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.771894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4d5e0-8d48-4108-bfd5-d7fd3a848f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.773533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4d5e0-8d48-4108-bfd5-d7fd3a848f89 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.796001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1017/2056] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:43.800235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:43.812417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5996-fb3f-446f-91a4-3b4239787981 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:43.819469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:43.821216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.821704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.821986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] PATH_INFO: `/v3/projects/ec7db35ea42c4354b72ae92e446700f5/users/4cd75d597c254acf9cfd152435fced05/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.824319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7db35ea42c4354b72ae92e446700f5, user_id=4cd75d597c254acf9cfd152435fced05, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:43.828121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:43.831241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:43.859239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1040/2057] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:43 2022] PUT /identity/v3/projects/ec7db35ea42c4354b72ae92e446700f5/users/4cd75d597c254acf9cfd152435fced05/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:43.860537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:43.861079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:43.861282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:43.921988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] MFA Rules not processed for user `4cd75d597c254acf9cfd152435fced05`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:43.923858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:44.083352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1018/2058] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:44.192556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:44.292355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5d0ff-3595-4a35-ad61-5eb7fe7995a1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:44.297443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:44.298297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:44.298791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:44.299250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:44.378936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:44.380556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:44.392068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1041/2059] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:44.901000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:44.910998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaa0c4-d900-4762-885c-7b4a53f04563 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:44.914920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:44.915603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:44.915997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:44.916338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:44.918128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:45.004290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:45.006036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:45.018884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1019/2060] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:45.714332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:45.723291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428565-832b-4133-986d-e7f87db6e899 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:45.727114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:45.727715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:45.728025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:45.728352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:45.804453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:45.806294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:45.818445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1042/2061] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:48.862924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:48.872204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592ed5a-cc21-4713-b2bf-c740b578e220 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:48.876742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:48.877416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:48.877715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:48.877989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:48.888062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:48.889693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:48.899897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1020/2062] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:49.803608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:49.879501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:49.909301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdfca3-821b-4dc4-9713-49bd02b91ae1 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:49.920810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:49.921450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:49.921725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:49.921994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] PATH_INFO: `/v3/users/3b08cbf85f0c453da63af318b1d3909e` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:49.923312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b08cbf85f0c453da63af318b1d3909e)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:49.925882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:49.990090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b08cbf85f0c453da63af318b1d3909e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:49.990751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b08cbf85f0c453da63af318b1d3909e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:49.991046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:49.992645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:49.997614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b08cbf85f0c453da63af318b1d3909e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:49.998355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b08cbf85f0c453da63af318b1d3909e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.006337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5fa23055-33f7-4d01-9d93-e08a14205b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b08cbf85f0c453da63af318b1d3909e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.006595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921008-f75c-4050-816f-70af32f51508 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:50.013011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:50.013870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:50.014314 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:50.015087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] PATH_INFO: `/v3/users/ce1b0a9edb7d4dfb8abfca1b61ba85ab` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:50.016479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1b0a9edb7d4dfb8abfca1b61ba85ab)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:50.018659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:50.027153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1043/2063] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:49 2022] DELETE /identity/v3/users/3b08cbf85f0c453da63af318b1d3909e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:50.032150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:50.032624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:50.033046 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:50.053326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:50.056667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:50.058669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:50.096552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1b0a9edb7d4dfb8abfca1b61ba85ab'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.107146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1b0a9edb7d4dfb8abfca1b61ba85ab'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.108570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1b0a9edb7d4dfb8abfca1b61ba85ab'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.123071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1b0a9edb7d4dfb8abfca1b61ba85ab'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.124325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7dcc71b6-488f-4331-8cd0-6aa884f1732b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1b0a9edb7d4dfb8abfca1b61ba85ab'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.136948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1044/2064] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:50.144405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1021/2065] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:49 2022] DELETE /identity/v3/users/ce1b0a9edb7d4dfb8abfca1b61ba85ab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:50.149089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:50.149248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:50.149509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:50.150942 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:50.152457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:50.181753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:50.183207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:50.224661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4655c5-fcbb-4f04-b67d-2cfcfe99c42c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:50.238463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:50.253372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1022/2066] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:50.268392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:50.283438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:50.284116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:50.284377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:50.284657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:50.298421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:50.299868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:50.333391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1045/2067] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:50.359772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5eb63-58d0-4dde-9b12-b0f210b34670 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:50.367907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:50.372815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:50.373553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:50.374782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:50.391085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:50.399168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:50.419158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1023/2068] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:50.844538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:50.846274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:50.861950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28947a79-f00f-46f0-94e8-48cebfd425e2 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:50.867224 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:50.868407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:50.869112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:50.869876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] PATH_INFO: `/v3/projects/088beea307b24c55932f2eaa9062ca61` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:50.871731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088beea307b24c55932f2eaa9062ca61)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:50.875079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:50.919274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:50.921638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:50.953346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088beea307b24c55932f2eaa9062ca61', 'request_id': 'req-b2a01c40-882e-4267-ae80-7d18c5ca6e08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.956455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09dc21-4261-4836-aea7-29ed2a7010bf service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:50.963128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088beea307b24c55932f2eaa9062ca61', 'request_id': 'req-b2a01c40-882e-4267-ae80-7d18c5ca6e08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.972205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088beea307b24c55932f2eaa9062ca61', 'request_id': 'req-b2a01c40-882e-4267-ae80-7d18c5ca6e08'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.997187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] The token cache is being invalidate because project 088beea307b24c55932f2eaa9062ca61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:50.997554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:50.998829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.001528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1046/2069] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:50 2022] DELETE /identity/v3/projects/088beea307b24c55932f2eaa9062ca61 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:51.005880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:51.009933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:51.014840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:51.035563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:51.036900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:51.037527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:51.037982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] PATH_INFO: `/v3/projects/71bfc5788f3940a68607ae375ace6d2f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:51.040001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bfc5788f3940a68607ae375ace6d2f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:51.042325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:51.108649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bfc5788f3940a68607ae375ace6d2f', 'request_id': 'req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.110495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01c40-882e-4267-ae80-7d18c5ca6e08 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:51.116238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bfc5788f3940a68607ae375ace6d2f', 'request_id': 'req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.125744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bfc5788f3940a68607ae375ace6d2f', 'request_id': 'req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.137496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] The token cache is being invalidate because project 71bfc5788f3940a68607ae375ace6d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:51.137885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.138596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.140321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1024/2070] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:50 2022] DELETE /identity/v3/projects/71bfc5788f3940a68607ae375ace6d2f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:51.144349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:51.145695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:51.166120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:51.181821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:51.182559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:51.182907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:51.183279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] PATH_INFO: `/v3/users/7b875ad1be984b2392afe24a6d7d6e18` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:51.184534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b875ad1be984b2392afe24a6d7d6e18)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:51.187019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:51.229900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1acf0-3ad5-4f76-bd13-5b6c29d0fe14 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:51.236584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:51.237221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:51.237529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:51.237796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] PATH_INFO: `/v3/users/4f9573f7c6be481fae30a6d8074a8a97` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:51.238960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9573f7c6be481fae30a6d8074a8a97)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:51.241257 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:51.249922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b875ad1be984b2392afe24a6d7d6e18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.250666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b875ad1be984b2392afe24a6d7d6e18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.259084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b875ad1be984b2392afe24a6d7d6e18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.259829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b875ad1be984b2392afe24a6d7d6e18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.270806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b875ad1be984b2392afe24a6d7d6e18'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.294152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1047/2071] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:51 2022] DELETE /identity/v3/users/7b875ad1be984b2392afe24a6d7d6e18 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:51.305352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9573f7c6be481fae30a6d8074a8a97'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.312755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9573f7c6be481fae30a6d8074a8a97'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.313420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9573f7c6be481fae30a6d8074a8a97'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.320787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9573f7c6be481fae30a6d8074a8a97'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.321396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9573f7c6be481fae30a6d8074a8a97'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:51.333673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:51.343030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1025/2072] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:51 2022] DELETE /identity/v3/users/4f9573f7c6be481fae30a6d8074a8a97 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:51.654374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:51.656446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:51.811109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628586e-6cc5-4d21-9de5-97d9db85fab5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:51.814165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:51.815914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:51.907054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:51.908143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:51.908552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:51.908925 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] PATH_INFO: `/v3/projects/d202d7200a434c90b6d2f928b5d9be60` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:51.911743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d202d7200a434c90b6d2f928b5d9be60)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:51.914373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:51.950850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:51.970120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939d2e7-a081-45d9-bcd4-f1dafbcafbaf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:51.978205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:51.980465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:51.983995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:51.984375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] PATH_INFO: `/v3/projects/4562e542ae3d445aa0ebed8cf6b6e49a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:51.987691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4562e542ae3d445aa0ebed8cf6b6e49a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:51.990074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.000075 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd202d7200a434c90b6d2f928b5d9be60', 'request_id': 'req-17072258-7d01-4a68-8bea-9e1e3dacd49f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.018700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd202d7200a434c90b6d2f928b5d9be60', 'request_id': 'req-17072258-7d01-4a68-8bea-9e1e3dacd49f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.038216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd202d7200a434c90b6d2f928b5d9be60', 'request_id': 'req-17072258-7d01-4a68-8bea-9e1e3dacd49f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.063755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] The token cache is being invalidate because project d202d7200a434c90b6d2f928b5d9be60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:52.064210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.065163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.067058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1048/2073] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:51 2022] DELETE /identity/v3/projects/d202d7200a434c90b6d2f928b5d9be60 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:52.071284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.072598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4562e542ae3d445aa0ebed8cf6b6e49a', 'request_id': 'req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.073363 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:52.104708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4562e542ae3d445aa0ebed8cf6b6e49a', 'request_id': 'req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.124423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4562e542ae3d445aa0ebed8cf6b6e49a', 'request_id': 'req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.153989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] The token cache is being invalidate because project 4562e542ae3d445aa0ebed8cf6b6e49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:52.155121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.157874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1bcd252b-4a9e-4fa5-9bf4-13b48a958033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.160565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1026/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:51 2022] DELETE /identity/v3/projects/4562e542ae3d445aa0ebed8cf6b6e49a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:52.167703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36f21-29d8-4aab-a02b-be8e72dc2465 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.168341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36f21-29d8-4aab-a02b-be8e72dc2465 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.168832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36f21-29d8-4aab-a02b-be8e72dc2465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.204914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4f36f21-29d8-4aab-a02b-be8e72dc2465 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:52.206296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4f36f21-29d8-4aab-a02b-be8e72dc2465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:52.265645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17072258-7d01-4a68-8bea-9e1e3dacd49f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.323596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1027/2075] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:52.332032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.332802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.333636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.387185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:52.390010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:52.399398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.400898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.401543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.401944 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] PATH_INFO: `/v3/users/c4fe36ff43b94ba88defa4d53e3c0c4b` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.404048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fe36ff43b94ba88defa4d53e3c0c4b)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.407236 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.416836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1028/2076] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:52.418104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.442700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65f559-e7e3-4990-b715-b9d9e0e8f48f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.450493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.451912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.452487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.452786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.453778 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:52.454152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.457966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.475991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1029/2077] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:52.476194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fe36ff43b94ba88defa4d53e3c0c4b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.476931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fe36ff43b94ba88defa4d53e3c0c4b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.477761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.485937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fe36ff43b94ba88defa4d53e3c0c4b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.486647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fe36ff43b94ba88defa4d53e3c0c4b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.488609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:52.495228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3668b-aa04-40d9-b1ca-a2d69b0ddacd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.501086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fe36ff43b94ba88defa4d53e3c0c4b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:52.508702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.509340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.509677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.509957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.510870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.514216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.520395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:52.529335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1049/2078] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:52 2022] DELETE /identity/v3/users/c4fe36ff43b94ba88defa4d53e3c0c4b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:52.561259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1030/2079] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:52 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:52.565551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.567092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:52.644879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4cb97-c9b9-42a8-a271-315bc9b6559d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.713030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.715200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.718878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.718878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.718878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.719353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.774517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1050/2080] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:52 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:52.775274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.792043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10307a1-a3fd-4edc-a707-9e3b908fdd9d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.809733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.810375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.810695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.810973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.811636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.813281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.828254 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1031/2081] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:52.832041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.844632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f626f8-42a3-4c51-9fe4-1f0c1f5bad68 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.849444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90ac1-8112-4233-8078-7f76c19744f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.850119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90ac1-8112-4233-8078-7f76c19744f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.850508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90ac1-8112-4233-8078-7f76c19744f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.850846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90ac1-8112-4233-8078-7f76c19744f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.851585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90ac1-8112-4233-8078-7f76c19744f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.853291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90ac1-8112-4233-8078-7f76c19744f7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.864432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1051/2082] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:52.869157 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:52.879424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea8628-e6b6-416c-af62-47f0b5bfea17 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:52.884381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:52.884823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.885139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.885633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] PATH_INFO: `/v3/projects/dac58b62eddb4b848dfbe713cb4c093c/users/db01108aad404b46a5560a228a588970/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.901586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac58b62eddb4b848dfbe713cb4c093c, user_id=db01108aad404b46a5560a228a588970, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:52.904815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:52.919311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1032/2083] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:52 2022] PUT /identity/v3/projects/dac58b62eddb4b848dfbe713cb4c093c/users/db01108aad404b46a5560a228a588970/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:52.929966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:52.930511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:52.930619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:52.993699 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] MFA Rules not processed for user `db01108aad404b46a5560a228a588970`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:52.995529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:53.058043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:53.089443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1052/2084] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:53.094751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.153489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.155601 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:53.224648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f5319-0e98-4c87-8b70-681010c37b36 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.231224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.231842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.232207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.232647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.233283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.235311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.247289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74c3fd-9598-4b64-8e2a-61f9494f27b5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.252935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.253820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.254191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.254616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] PATH_INFO: `/v3/projects/139a85cfdc1d43d081b8c26be90d0c1f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.256060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=139a85cfdc1d43d081b8c26be90d0c1f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.259254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.266575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1033/2085] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:53.270733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.318682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139a85cfdc1d43d081b8c26be90d0c1f', 'request_id': 'req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:53.336550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139a85cfdc1d43d081b8c26be90d0c1f', 'request_id': 'req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:53.349519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62ed8-7ce7-42a0-a338-dd961828b342 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.351336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139a85cfdc1d43d081b8c26be90d0c1f', 'request_id': 'req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:53.365470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] The token cache is being invalidate because project 139a85cfdc1d43d081b8c26be90d0c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:53.365763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:53.366501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-53f7a9d7-cd27-46d1-854d-87e86d3d4d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:53.368083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1053/2086] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:53 2022] DELETE /identity/v3/projects/139a85cfdc1d43d081b8c26be90d0c1f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:53.372838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee45e76-4a1e-4c5f-b17e-8133d2427e7c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.373357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee45e76-4a1e-4c5f-b17e-8133d2427e7c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.373827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee45e76-4a1e-4c5f-b17e-8133d2427e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.397382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6ee45e76-4a1e-4c5f-b17e-8133d2427e7c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:53.398708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6ee45e76-4a1e-4c5f-b17e-8133d2427e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:53.410326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:53.433228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.434096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.434418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.435609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.436786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.438302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.472833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1034/2087] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:53.477805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.483878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:53.501408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956c47d-382e-4a5f-a20b-b65613886603 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.506959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1054/2088] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:53.510657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.511288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.511567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.511840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.512527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.514672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.515304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.515783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.516149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.538233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1035/2089] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:53.542339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.548167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:53.550337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:53.563294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c0302-b984-42b2-810b-01f65bf5b2e7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.568817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1055/2090] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:53.569845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.580956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.581964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.582433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.582813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112a9d3-9927-4825-a6d8-7b4c856579a2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.583066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] PATH_INFO: `/v3/projects/c5751010e75a4048846b7fc472e3ad4d/users/14c8c836798d46ae8cbcebda62f06214/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.588579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.589816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.590177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.590737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.593586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:53.594003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.595985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.608944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5751010e75a4048846b7fc472e3ad4d, user_id=14c8c836798d46ae8cbcebda62f06214, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.615596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.618546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:53.626119 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1056/2091] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:53.630979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.640466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1036/2092] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:53 2022] PUT /identity/v3/projects/c5751010e75a4048846b7fc472e3ad4d/users/14c8c836798d46ae8cbcebda62f06214/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:53.641580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.650062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab26e47-6536-4110-8359-e4ff57f87046 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.719778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.720577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.720921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.721199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.721845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.728631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.752590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb346bf-6789-42bd-95c5-689bfd6a98f1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.760919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.761971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.762479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.763000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.764596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.765735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.769817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1057/2093] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:53.775491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.780882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1037/2094] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:53.781773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.794277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc1bd-cfe5-45b1-8c9f-26c2e4457f18 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.914986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f530b-9bf9-4260-813b-b6c82347b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.915724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f530b-9bf9-4260-813b-b6c82347b6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.916073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f530b-9bf9-4260-813b-b6c82347b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.916350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f530b-9bf9-4260-813b-b6c82347b6d2 admin admin] PATH_INFO: `/v3/projects/c5751010e75a4048846b7fc472e3ad4d/users/14c8c836798d46ae8cbcebda62f06214/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.918351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f530b-9bf9-4260-813b-b6c82347b6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5751010e75a4048846b7fc472e3ad4d, user_id=14c8c836798d46ae8cbcebda62f06214, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.918797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d8a0-acb3-4266-a378-cd95785c3d62 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.921577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f530b-9bf9-4260-813b-b6c82347b6d2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.926939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:53.927789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.928365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.928495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.929492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:53.931207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:53.949033 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1038/2095] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:53 2022] PUT /identity/v3/projects/c5751010e75a4048846b7fc472e3ad4d/users/14c8c836798d46ae8cbcebda62f06214/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:53.951233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:53.951620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:53.951999 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:53.960495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1058/2096] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:53.964891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:53.979773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd601a3-cd5b-44fa-b931-8e49bf6f1daa admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:53.987498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] MFA Rules not processed for user `14c8c836798d46ae8cbcebda62f06214`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:53.989125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.006830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:54.071716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.072778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.072778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.073188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.073960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.076278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.090940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1059/2097] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:18:54.092147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.093849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1039/2098] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:54.104302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.105685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.107000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55c3aa-7fb6-47b9-be42-51be366f7b8e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.113267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.114092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.114499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.114918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.115736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.118040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.125514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:54.133178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1060/2099] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:54.137774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.149021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60353462-0cef-48b9-aaa6-21030b8097cd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.155429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c03ea7-16c9-4ee5-85b3-70aaf31085c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.155980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c03ea7-16c9-4ee5-85b3-70aaf31085c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.155980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c03ea7-16c9-4ee5-85b3-70aaf31085c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.156353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c03ea7-16c9-4ee5-85b3-70aaf31085c8 admin admin] PATH_INFO: `/v3/projects/ad4597e82beb489597db19233989551f/users/9a3fa120d6ef4836bd28abe827bd9ec9/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.173402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c03ea7-16c9-4ee5-85b3-70aaf31085c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4597e82beb489597db19233989551f, user_id=9a3fa120d6ef4836bd28abe827bd9ec9, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.178009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7da2fd-0ef1-4f24-a8c3-89c7f3df9244 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.178594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c03ea7-16c9-4ee5-85b3-70aaf31085c8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.186668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.187655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.188146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.188911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.206889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1061/2100] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:54 2022] PUT /identity/v3/projects/ad4597e82beb489597db19233989551f/users/9a3fa120d6ef4836bd28abe827bd9ec9/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:54.216835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.218772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.219156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.219476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.220952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.256357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] MFA Rules not processed for user `9a3fa120d6ef4836bd28abe827bd9ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:54.258422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.258594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1040/2101] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:18:54.259731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.263661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.292700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be65d-685e-4c45-ab95-0bfe4e7ca9a4 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.374579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1062/2102] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:54.379285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.466251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.468621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.468907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.469182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] PATH_INFO: `/v3/users/c85c030e2ca74dff9368cf711ccc929b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.471017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85c030e2ca74dff9368cf711ccc929b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.473467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.540337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe89f-0424-472d-b64c-b23a6d89e17b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.544005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85c030e2ca74dff9368cf711ccc929b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:54.547078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1c123-8da1-42c6-b6ea-79a4061fdacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.547744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1c123-8da1-42c6-b6ea-79a4061fdacf admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.550070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1c123-8da1-42c6-b6ea-79a4061fdacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.550311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1c123-8da1-42c6-b6ea-79a4061fdacf admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.551060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1c123-8da1-42c6-b6ea-79a4061fdacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.559199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85c030e2ca74dff9368cf711ccc929b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:54.561440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85c030e2ca74dff9368cf711ccc929b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:54.563283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1c123-8da1-42c6-b6ea-79a4061fdacf admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.564971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:54.575862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85c030e2ca74dff9368cf711ccc929b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:54.581373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85c030e2ca74dff9368cf711ccc929b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:54.613216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1063/2103] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:54 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:54.618399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1041/2104] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:54 2022] DELETE /identity/v3/users/c85c030e2ca74dff9368cf711ccc929b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:54.619548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.619889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.620329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.620713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.621683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.673981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:54.674762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.739132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:54.764926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1064/2105] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:18:54.778141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.780828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:54.792492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1e97-e880-4afd-9049-525421cce5b6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.817926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.818724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.819007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.819280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.819924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.823660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.871730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1042/2106] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:54 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:54.874631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.895086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a08e8-cf5d-4a78-bdae-fe3d0353c5a2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.901693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfacca-0394-4ef0-9e20-ee7fb2c74d5b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:54.922979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.922979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.926360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.928261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:54.928512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.931462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.932902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:54.936851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:54.937005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:54.940162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.957780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:54.959652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:54.965696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1043/2107] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:54.972419 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:54.984801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1065/2108] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:55.016067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763a19a-bad5-4fe2-8d42-e90b4dceb721 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:55.021450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc677c3-5252-4d3f-ac41-4360844e4e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:55.022337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc677c3-5252-4d3f-ac41-4360844e4e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:55.022977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc677c3-5252-4d3f-ac41-4360844e4e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:55.023389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc677c3-5252-4d3f-ac41-4360844e4e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:55.024853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc677c3-5252-4d3f-ac41-4360844e4e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:55.026847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc677c3-5252-4d3f-ac41-4360844e4e65 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:55.039426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1044/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:55.043640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:55.058886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c1876-836d-451e-b8ef-e221580e22b6 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:55.065142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:55.065729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:55.066009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:55.066325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] PATH_INFO: `/v3/projects/1449507328c14ba8b4e70217a5351cb5/users/3ea453157e13456bb4c9eaa6bc80aa81/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:55.106210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1449507328c14ba8b4e70217a5351cb5, user_id=3ea453157e13456bb4c9eaa6bc80aa81, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:55.109624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:55.135197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1066/2110] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:55 2022] PUT /identity/v3/projects/1449507328c14ba8b4e70217a5351cb5/users/3ea453157e13456bb4c9eaa6bc80aa81/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:55.155896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e62052-c514-4016-b363-00dcc1821031 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:55.156564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e62052-c514-4016-b363-00dcc1821031 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:55.157811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e62052-c514-4016-b363-00dcc1821031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:55.238538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-96e62052-c514-4016-b363-00dcc1821031 None None] MFA Rules not processed for user `3ea453157e13456bb4c9eaa6bc80aa81`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:55.249227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-96e62052-c514-4016-b363-00dcc1821031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:55.518131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1045/2111] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:55.525402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:55.685064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e62052-c514-4016-b363-00dcc1821031 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:55.687358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-96e62052-c514-4016-b363-00dcc1821031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:55.700181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45dac-afed-4151-aa3e-50b2c00e02fc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:55.708173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:55.708665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:55.708990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:55.709758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:55.710078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:55.711226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e62052-c514-4016-b363-00dcc1821031 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:55.712529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:55.720785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:55.721792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:55.722279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:55.722760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] PATH_INFO: `/v3/projects/890c55959ca344c29c5cfac0cae7fb53` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:55.724696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890c55959ca344c29c5cfac0cae7fb53)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:55.728060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:55.752005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1067/2112] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:55 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:55.756422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:55.795963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:55.827827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890c55959ca344c29c5cfac0cae7fb53', 'request_id': 'req-70eb3521-e50c-4cf2-bbd3-de6853f6f611'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:55.836334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890c55959ca344c29c5cfac0cae7fb53', 'request_id': 'req-70eb3521-e50c-4cf2-bbd3-de6853f6f611'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:55.850742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890c55959ca344c29c5cfac0cae7fb53', 'request_id': 'req-70eb3521-e50c-4cf2-bbd3-de6853f6f611'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:55.860894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:55.867526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19b7be-5a4e-4a37-9618-655077920cfd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:55.879762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] The token cache is being invalidate because project 890c55959ca344c29c5cfac0cae7fb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:55.880094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:55.880869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:55.882806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1046/2113] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:55 2022] DELETE /identity/v3/projects/890c55959ca344c29c5cfac0cae7fb53 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:55.888788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:55.890875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:55.987484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:55.988378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:55.988733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:55.989193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:55.989976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:55.992436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:55.995728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3521-e50c-4cf2-bbd3-de6853f6f611 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:56.006467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:56.007134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.007408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.007704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] PATH_INFO: `/v3/users/4cd75d597c254acf9cfd152435fced05` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.009339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd75d597c254acf9cfd152435fced05)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:56.011685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:56.029748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1068/2114] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:55 2022] POST /identity/v3/users => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:56.034738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:56.042413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:56.081457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85322-2d35-4ae6-82c7-f11fe6fcc04c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:56.105175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:56.105982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.106313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.106594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.108628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:56.110706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:56.126077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1069/2115] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:56.132298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:56.139635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd75d597c254acf9cfd152435fced05'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:56.150682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bba64b-d322-4382-a85a-babb1428e0e0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:56.159863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:56.161243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.161747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.162094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] PATH_INFO: `/v3/projects/3344814c7bf447eabdf907031417d37c/users/753826bba55645c39881a6e712805333/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.163796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd75d597c254acf9cfd152435fced05'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:56.165163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd75d597c254acf9cfd152435fced05'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:56.183835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd75d597c254acf9cfd152435fced05'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:56.184769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd75d597c254acf9cfd152435fced05'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:56.191757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3344814c7bf447eabdf907031417d37c, user_id=753826bba55645c39881a6e712805333, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:56.196533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:56.209355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1047/2116] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:55 2022] DELETE /identity/v3/users/4cd75d597c254acf9cfd152435fced05 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:56.221846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1070/2117] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:56 2022] PUT /identity/v3/projects/3344814c7bf447eabdf907031417d37c/users/753826bba55645c39881a6e712805333/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:56.225997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:56.229235 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:56.283799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:56.350233 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede70c63-02f1-4fa9-bc8a-2ade486f46a2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:56.489111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bede2-1f7f-4565-9bb0-93936dc427da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:56.489745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bede2-1f7f-4565-9bb0-93936dc427da admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.490019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bede2-1f7f-4565-9bb0-93936dc427da admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.490294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bede2-1f7f-4565-9bb0-93936dc427da admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.491002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bede2-1f7f-4565-9bb0-93936dc427da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:56.496902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bede2-1f7f-4565-9bb0-93936dc427da admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:56.526461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1048/2118] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:56.531140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:56.549123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73023f-3ef9-42ad-ada6-9a34219307bd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:56.568462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:56.569198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.569473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.569739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] PATH_INFO: `/v3/projects/3344814c7bf447eabdf907031417d37c/users/753826bba55645c39881a6e712805333/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.575212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3344814c7bf447eabdf907031417d37c, user_id=753826bba55645c39881a6e712805333, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:56.584129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:56.609983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1071/2119] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:56 2022] PUT /identity/v3/projects/3344814c7bf447eabdf907031417d37c/users/753826bba55645c39881a6e712805333/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:56.626523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.626815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.627094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.703273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] MFA Rules not processed for user `753826bba55645c39881a6e712805333`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:56.706236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:56.742126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:56.744682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:56.873955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1049/2120] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:56.899430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:56.900990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:56.934677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae963e-1fb7-4d03-9fc3-f38aeefb433e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:56.948073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:56.953663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:56.953950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:56.954227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] PATH_INFO: `/v3/users/db01108aad404b46a5560a228a588970` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:56.956526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db01108aad404b46a5560a228a588970)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:56.959315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.038438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b40d0-147e-417c-babc-27507aa94535 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.042595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.043200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.043546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.043876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.046624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.047230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:57.050170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db01108aad404b46a5560a228a588970'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.052078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db01108aad404b46a5560a228a588970'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.066454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db01108aad404b46a5560a228a588970'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.067215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db01108aad404b46a5560a228a588970'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.078456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db01108aad404b46a5560a228a588970'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.081549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:57.101674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1072/2121] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:56 2022] DELETE /identity/v3/users/db01108aad404b46a5560a228a588970 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:57.104868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.108946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.187373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.194516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dec7e3-eda2-40ce-b515-b82c6e578648 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.208947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1050/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:57.210654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.211074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.211500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.236719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:57.238565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.241190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48934-d5fe-4d74-b996-4eb151e4d2c1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.246814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.247503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.248375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.248494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1051/2123] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:57.248880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] PATH_INFO: `/v3/projects/ec7db35ea42c4354b72ae92e446700f5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.259536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.261303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7db35ea42c4354b72ae92e446700f5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.264415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.265362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.337853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7db35ea42c4354b72ae92e446700f5', 'request_id': 'req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.346529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7db35ea42c4354b72ae92e446700f5', 'request_id': 'req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.348657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273b213-b56a-4736-a4a7-db1396e139d3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.354286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7db35ea42c4354b72ae92e446700f5', 'request_id': 'req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.374039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] The token cache is being invalidate because project ec7db35ea42c4354b72ae92e446700f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:57.374420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.375397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1610b6bd-3a08-4963-9c50-f0dc1ae6449a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.388329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1073/2124] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:57 2022] DELETE /identity/v3/projects/ec7db35ea42c4354b72ae92e446700f5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:57.390402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f5982-6b64-4180-86a5-556c8b30f0f7 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.390687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f5982-6b64-4180-86a5-556c8b30f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.390959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f5982-6b64-4180-86a5-556c8b30f0f7 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.392496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1074/2125] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:18:57.393355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.393639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.393904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.416670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.417226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:57.417633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.418031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.418433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.418544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.420896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.479072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:57.501542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1075/2126] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:57.509211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.509211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.509376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.511047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6fdd8-a8d9-4f5b-be30-c574e2993c97 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.517276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbfa29-0c4f-44a7-936d-7489ba292887 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.522833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.523532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.523797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.524692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] PATH_INFO: `/v3/users/9e21985df0d94752864f7858ca71e05d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.525051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1052/2127] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:57.526662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.527248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.527417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.532920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e21985df0d94752864f7858ca71e05d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.535389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.553007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:57.554382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.583968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:57.612729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e21985df0d94752864f7858ca71e05d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.613451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e21985df0d94752864f7858ca71e05d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.627139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e21985df0d94752864f7858ca71e05d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.629062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e21985df0d94752864f7858ca71e05d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.641278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3b94968c-18b4-44af-88a5-3d0461ac84b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e21985df0d94752864f7858ca71e05d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:57.684469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1076/2128] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:57 2022] DELETE /identity/v3/users/9e21985df0d94752864f7858ca71e05d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:57.684637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1053/2129] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:57.688720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.689048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.689329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.698928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.701646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.714951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:57.716276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.717972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d3de1-66f8-4542-8117-0f3b73e30973 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.796870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.797508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.798401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.798769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.807983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1077/2130] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:57.812199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.813368 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.814459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.829215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1054/2131] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:57.831433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcf74-f4ce-4410-ba90-66e9ea6348b1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.844904 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.845773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.846083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.846631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.847533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:57.848329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.850488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.866436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1078/2132] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:57.871259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.888908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceb248-a3e0-4769-bd1d-ca2c9fde0eca service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.895408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.896410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.896883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.897220 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.898027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.900693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.906773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.910032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:57.925474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49888608-d149-4014-b696-03f5bca56dad admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:57.931524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:57.932346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:57.932743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:57.933229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] PATH_INFO: `/v3/projects/dac58b62eddb4b848dfbe713cb4c093c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:57.936821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac58b62eddb4b848dfbe713cb4c093c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:57.938795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:57.949705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1055/2133] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:57 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:57.951141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:57.998696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:58.000655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac58b62eddb4b848dfbe713cb4c093c', 'request_id': 'req-08de6260-683c-41c5-8389-5c6f14a637f3'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.011589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac58b62eddb4b848dfbe713cb4c093c', 'request_id': 'req-08de6260-683c-41c5-8389-5c6f14a637f3'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.018663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac58b62eddb4b848dfbe713cb4c093c', 'request_id': 'req-08de6260-683c-41c5-8389-5c6f14a637f3'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.027752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f2ce8-407d-448b-8465-7f16221375fa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.028901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] The token cache is being invalidate because project dac58b62eddb4b848dfbe713cb4c093c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:58.029723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.030364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.031846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1079/2134] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:57 2022] DELETE /identity/v3/projects/dac58b62eddb4b848dfbe713cb4c093c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:58.032636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.035136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.058676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:58.106532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6260-683c-41c5-8389-5c6f14a637f3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.109512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.110168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.110440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.110707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.111501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.113901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.120832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.121550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.121891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.122255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] PATH_INFO: `/v3/projects/d0bb6e266bd7463a82a9b901527fe4fe` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.124037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bb6e266bd7463a82a9b901527fe4fe)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.126068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.151998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1056/2135] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:57 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:18:58.152924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.156139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.174806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db020913-31de-490b-a0cc-9d5541831571 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.188571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bb6e266bd7463a82a9b901527fe4fe', 'request_id': 'req-312446b4-1581-43be-b070-7a19015b4f2b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.212836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bb6e266bd7463a82a9b901527fe4fe', 'request_id': 'req-312446b4-1581-43be-b070-7a19015b4f2b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.227689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bb6e266bd7463a82a9b901527fe4fe', 'request_id': 'req-312446b4-1581-43be-b070-7a19015b4f2b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.241749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] The token cache is being invalidate because project d0bb6e266bd7463a82a9b901527fe4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:58.242194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.242951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.248963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1080/2136] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:58 2022] DELETE /identity/v3/projects/d0bb6e266bd7463a82a9b901527fe4fe => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:58.250845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.254236 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.275138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.276358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.276652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.276927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] PATH_INFO: `/v3/users/14c8c836798d46ae8cbcebda62f06214` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.278564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c8c836798d46ae8cbcebda62f06214)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.281317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.334719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c8c836798d46ae8cbcebda62f06214'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.335596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312446b4-1581-43be-b070-7a19015b4f2b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.340610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da380e-530d-4452-b49d-e87319d5f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.341392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da380e-530d-4452-b49d-e87319d5f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.342027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da380e-530d-4452-b49d-e87319d5f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.342448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da380e-530d-4452-b49d-e87319d5f3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.343143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da380e-530d-4452-b49d-e87319d5f3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.343966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c8c836798d46ae8cbcebda62f06214'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.344933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da380e-530d-4452-b49d-e87319d5f3a3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.345068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c8c836798d46ae8cbcebda62f06214'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.355486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c8c836798d46ae8cbcebda62f06214'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.356678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c8c836798d46ae8cbcebda62f06214'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.361082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1081/2137] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:58.361082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e020e1-7ebd-4a15-99a2-b8afc21f69d9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.361082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e020e1-7ebd-4a15-99a2-b8afc21f69d9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.361082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e020e1-7ebd-4a15-99a2-b8afc21f69d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.368513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:58.380897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1057/2138] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:58 2022] DELETE /identity/v3/users/14c8c836798d46ae8cbcebda62f06214 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:58.385039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.386712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.401981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-38e020e1-7ebd-4a15-99a2-b8afc21f69d9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:58.405213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-38e020e1-7ebd-4a15-99a2-b8afc21f69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.443913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:58.486660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0c9e-ff5c-47e6-b9fd-bff35f7b1ced admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.494306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.494936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.495211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.495481 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.496164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.499660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.514516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1058/2139] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:58.519501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.528036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1082/2140] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:58.534867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3fe3a-ae32-48c2-b2f3-96032c517c40 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.536841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.537144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.537249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e2136-6bcc-42a6-b481-ba5cd109eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.537471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.537915 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e2136-6bcc-42a6-b481-ba5cd109eb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.538191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e2136-6bcc-42a6-b481-ba5cd109eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.538463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e2136-6bcc-42a6-b481-ba5cd109eb53 admin admin] PATH_INFO: `/v3/projects/71618010a07647c1bfe16a8c70166f28/users/f41611c08d9c4887b756d65019d0da5f/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.557811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e2136-6bcc-42a6-b481-ba5cd109eb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71618010a07647c1bfe16a8c70166f28, user_id=f41611c08d9c4887b756d65019d0da5f, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.560784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e2136-6bcc-42a6-b481-ba5cd109eb53 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.584065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1059/2141] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:58 2022] PUT /identity/v3/projects/71618010a07647c1bfe16a8c70166f28/users/f41611c08d9c4887b756d65019d0da5f/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:58.584427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:58.584427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.590365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.590681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.590949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.626553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] MFA Rules not processed for user `f41611c08d9c4887b756d65019d0da5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:58.628851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.655908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1083/2142] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:58.660654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.677179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7928b2-11e6-4685-bc0d-3e8a2f8e0163 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.684369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.685067 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.685371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.685727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.690383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:58.692107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.694658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.712001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1084/2143] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:58.712001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.712437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.719801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1060/2144] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:58.721281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.742759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e90e8-5e3a-43f9-a0c2-d0ce574d2bbd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.745138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804b68-f893-4985-86d3-f014a3ef7626 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.749937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.750523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.750802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.751073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.751828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.753870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.754733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.755447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.755858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.756399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] PATH_INFO: `/v3/projects/c5751010e75a4048846b7fc472e3ad4d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.757730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5751010e75a4048846b7fc472e3ad4d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.760149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.786427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1061/2145] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:58 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:58.787466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.789348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.826652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5751010e75a4048846b7fc472e3ad4d', 'request_id': 'req-4853b363-6661-4fb6-85ae-99b4df799161'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.835848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5751010e75a4048846b7fc472e3ad4d', 'request_id': 'req-4853b363-6661-4fb6-85ae-99b4df799161'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.843879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5751010e75a4048846b7fc472e3ad4d', 'request_id': 'req-4853b363-6661-4fb6-85ae-99b4df799161'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.855221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] The token cache is being invalidate because project c5751010e75a4048846b7fc472e3ad4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:18:58.855618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.856305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:58.856536 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6136236-0cab-448a-a684-f23a1fc055f5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.860126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1085/2146] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:18:58 2022] DELETE /identity/v3/projects/c5751010e75a4048846b7fc472e3ad4d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:58.860126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:58.861585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.887343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:58.894546 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:58.922462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.923519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.924045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.924274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.926249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:58.946337 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853b363-6661-4fb6-85ae-99b4df799161 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:58.951163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeceedb-a17d-4640-90f6-656b87bccc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:58.952348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeceedb-a17d-4640-90f6-656b87bccc7f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.952642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeceedb-a17d-4640-90f6-656b87bccc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.952913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeceedb-a17d-4640-90f6-656b87bccc7f admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.953545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeceedb-a17d-4640-90f6-656b87bccc7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.955458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeceedb-a17d-4640-90f6-656b87bccc7f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.975666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1086/2147] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:58 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:58.976926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:58.977217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:58.977499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:58.990091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:58.991576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:58.996839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:58.998572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.001148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1062/2148] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:59.001931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.003267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.014168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1087/2149] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:59.014168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.015070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3d9b3-1034-4c0f-8f9e-583cf3052c7c service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.018720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.019321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.019592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.019865 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.021719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.032911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bcf0-d8c3-421f-9854-12f240f43492 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.037658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9efbb8-18e3-4d8f-b1b6-8305e58dd7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.038257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9efbb8-18e3-4d8f-b1b6-8305e58dd7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.038540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9efbb8-18e3-4d8f-b1b6-8305e58dd7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.038800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9efbb8-18e3-4d8f-b1b6-8305e58dd7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.039434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9efbb8-18e3-4d8f-b1b6-8305e58dd7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.041065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9efbb8-18e3-4d8f-b1b6-8305e58dd7d4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.052169 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1088/2150] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:59.053214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.053496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.053768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.073559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:59.074951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.083580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1089/2151] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:59.084709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.086049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.091805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.093271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.097606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6db589-07b5-4027-836e-4bb36fedaff6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.102112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.102529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1063/2152] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:59.103316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.107477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.107967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.108374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] PATH_INFO: `/v3/users/f41611c08d9c4887b756d65019d0da5f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.109372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41611c08d9c4887b756d65019d0da5f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.111285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.113961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89047e3-580a-4efc-b80e-fc01e91b5521 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.118782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.119371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.119644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.119914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.120571 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.122171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.133138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1064/2153] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:59.137439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.149103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edc20-1b3f-48e8-ad6c-30f44c773360 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.154609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.155289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.155542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.155810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.156514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:18:59.156816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.158433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.167723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41611c08d9c4887b756d65019d0da5f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:59.168669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41611c08d9c4887b756d65019d0da5f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:59.176055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1065/2154] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:18:59.176055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.177206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41611c08d9c4887b756d65019d0da5f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:59.177957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41611c08d9c4887b756d65019d0da5f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:59.187157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41611c08d9c4887b756d65019d0da5f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:18:59.187322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb07ab3-cb7c-4f4b-bde7-eeb6048dfe9b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.192792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835738ef-eb48-45a0-b943-7f34d4e6749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.193450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835738ef-eb48-45a0-b943-7f34d4e6749c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.193732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835738ef-eb48-45a0-b943-7f34d4e6749c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.193998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835738ef-eb48-45a0-b943-7f34d4e6749c admin admin] PATH_INFO: `/v3/projects/56427aed2fb54aaa89d904d7b50734c4/users/6b206c654b8f402785a06c31dd36ca40/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.209053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1090/2155] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:18:59 2022] DELETE /identity/v3/users/f41611c08d9c4887b756d65019d0da5f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:59.209981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.211331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.212713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835738ef-eb48-45a0-b943-7f34d4e6749c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56427aed2fb54aaa89d904d7b50734c4, user_id=6b206c654b8f402785a06c31dd36ca40, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.215556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835738ef-eb48-45a0-b943-7f34d4e6749c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.234038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1066/2156] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:59 2022] PUT /identity/v3/projects/56427aed2fb54aaa89d904d7b50734c4/users/6b206c654b8f402785a06c31dd36ca40/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:18:59.235300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722836f-63ea-418f-ac83-c4cbf9bb68ae None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.235583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722836f-63ea-418f-ac83-c4cbf9bb68ae None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.235853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722836f-63ea-418f-ac83-c4cbf9bb68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.257171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f722836f-63ea-418f-ac83-c4cbf9bb68ae None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:59.258429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f722836f-63ea-418f-ac83-c4cbf9bb68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.292640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:59.310173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:59.317106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c506a7-0183-4e52-9672-94e8095bb880 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.347591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1067/2157] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:59.348959 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.349305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.349644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.369229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:59.370533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.380431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1068/2158] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:18:59.381390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.382993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.429509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.430131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.430544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.430973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.431728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.434080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.465947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa876c9a-16ca-4dad-9cb4-1d7ec795037a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.469091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1091/2159] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:18:59 2022] POST /identity/v3/projects => generated 391 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:59.473578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.476352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.476987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.477271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.477544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.488849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.490339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.501813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1069/2160] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:59.502691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.513617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6abe9c-de5a-4456-8289-6e43214deee5 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.592527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff88cc-eb13-47c8-b73b-c9ce47a73906 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.604307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.605507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.605835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.606147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.612716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.613445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.613891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.614281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.615126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.617757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.631848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.634977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.647680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1092/2161] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:18:59.662797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1070/2162] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:18:59 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:18:59.667202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.682335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92890-7bea-445f-9be9-d9290602a456 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.689450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.690167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.690551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.690879 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.692580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.695242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.713181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1093/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:59.713867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.740586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc9af-5ebb-4ea7-ba57-0e2368975816 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.749274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb80b9-e91b-4052-970e-4cc2cf1bccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.749906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb80b9-e91b-4052-970e-4cc2cf1bccb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.750183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb80b9-e91b-4052-970e-4cc2cf1bccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.750513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb80b9-e91b-4052-970e-4cc2cf1bccb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.751238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb80b9-e91b-4052-970e-4cc2cf1bccb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.753075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb80b9-e91b-4052-970e-4cc2cf1bccb6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.772344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1071/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:18:59.774430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.790165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b9963-8e59-47fc-a2bf-8b337363a2f8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:18:59.799444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:18:59.801043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.801684 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.802492 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] PATH_INFO: `/v3/projects/56ce76de2bfd49489f901787f01d6f6b/users/fdd9d205c0404de2907e2776f0dc4281/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.846122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ce76de2bfd49489f901787f01d6f6b, user_id=fdd9d205c0404de2907e2776f0dc4281, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:18:59.853258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:18:59.880367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1094/2165] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:18:59 2022] PUT /identity/v3/projects/56ce76de2bfd49489f901787f01d6f6b/users/fdd9d205c0404de2907e2776f0dc4281/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:18:59.893595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:18:59.893595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:18:59.893896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:18:59.932069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] MFA Rules not processed for user `fdd9d205c0404de2907e2776f0dc4281`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:18:59.933489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:18:59.936980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:18:59.938894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:00.036986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb694939-ed22-4d59-905d-c3a6fd57e272 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.038077 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:00.042528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.043485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.043987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.044619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.047387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:00.056556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:00.090876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1072/2166] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:00.092870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.098389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:00.144815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.147152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.163186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1095/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:00.164063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.210804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627f07-9335-436b-9764-6b0e2e1ab3f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.218585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.220026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.220026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.220026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] PATH_INFO: `/v3/projects/71618010a07647c1bfe16a8c70166f28` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.221118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71618010a07647c1bfe16a8c70166f28)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.223552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.311870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffeb4c-0afa-4981-89de-cc7b3b044573 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.318253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71618010a07647c1bfe16a8c70166f28', 'request_id': 'req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:00.341688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71618010a07647c1bfe16a8c70166f28', 'request_id': 'req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:00.354943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71618010a07647c1bfe16a8c70166f28', 'request_id': 'req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:00.375808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] The token cache is being invalidate because project 71618010a07647c1bfe16a8c70166f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:00.376174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:00.377677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-82fffeac-fd6b-4e2b-a6d2-9e264a8b80e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:00.381216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1073/2168] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:00 2022] DELETE /identity/v3/projects/71618010a07647c1bfe16a8c70166f28 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:00.387821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6abb4-8bdd-4859-89e3-7b40920402ce None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.389065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6abb4-8bdd-4859-89e3-7b40920402ce None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.389676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6abb4-8bdd-4859-89e3-7b40920402ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.420359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-21c6abb4-8bdd-4859-89e3-7b40920402ce None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:00.423104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-21c6abb4-8bdd-4859-89e3-7b40920402ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:00.461642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.462259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.462641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.468213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.468213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.468213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.530894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1096/2169] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:00 2022] POST /identity/v3/projects => generated 391 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:00.533596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1074/2170] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:00.541231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.543985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.544889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.545212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.545706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:00.575029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:00.576845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:00.586453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:00.600600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:00.668262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197ec3-87fa-4a63-b592-cacc6f9dba73 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.688317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.689754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.690426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.690943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.692069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.693462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1075/2171] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:00.694761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.697694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.714639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e8e35-fa9a-4bd4-8973-6d63e561615f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.721725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.722898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.723990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.724273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.725347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:00.725907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.726317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1097/2172] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:00 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:00.727649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.730721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.742104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7230b-12ca-4556-bbda-6805fbce4766 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.742945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1076/2173] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:19:00.747472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.749150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.749532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.750128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.750407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.751142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.753729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.766375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af4fed-3512-4586-b529-d444f35202ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.769951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1098/2174] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:00.770864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.775092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.777051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.777743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.780268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.781663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.782893 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca67c0-6426-441b-b128-9f269485e8cf admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.786136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.788261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.788948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.789211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.789480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] PATH_INFO: `/v3/projects/7ac7175f3b004815898829732aa3bb85/users/1a9fab364704412cb17369e4b574f13d/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.814288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac7175f3b004815898829732aa3bb85, user_id=1a9fab364704412cb17369e4b574f13d, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.817043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.837495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1099/2175] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:00 2022] PUT /identity/v3/projects/7ac7175f3b004815898829732aa3bb85/users/1a9fab364704412cb17369e4b574f13d/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:00.841044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1077/2176] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:00.843329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.848065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.934776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ea33-c27b-4a90-b6df-0ad4f6790293 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.938124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52453f-8092-42a4-bd73-c22192b15d6f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.943095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.943799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.944116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.944443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.945151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.945678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.946583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.947001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.947352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.947563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.948697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.950476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:00.966340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1100/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:00.970999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.980003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1078/2178] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:00 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:00.983466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49d56-af44-4604-8b6d-4c0257874299 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:00.984731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:00.991489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c853d9-f0b2-46d9-baf4-f8ab39641054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:00.992621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c853d9-f0b2-46d9-baf4-f8ab39641054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:00.992903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c853d9-f0b2-46d9-baf4-f8ab39641054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:00.993174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c853d9-f0b2-46d9-baf4-f8ab39641054 admin admin] PATH_INFO: `/v3/projects/7ac7175f3b004815898829732aa3bb85/users/1a9fab364704412cb17369e4b574f13d/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:00.995989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c853d9-f0b2-46d9-baf4-f8ab39641054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac7175f3b004815898829732aa3bb85, user_id=1a9fab364704412cb17369e4b574f13d, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:00.999293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714de1-efbf-488e-a909-861254f17f4b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:01.000239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c853d9-f0b2-46d9-baf4-f8ab39641054 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.006200 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:01.007104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.007840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.008320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.009547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:01.012204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.015972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1101/2179] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:00 2022] PUT /identity/v3/projects/7ac7175f3b004815898829732aa3bb85/users/1a9fab364704412cb17369e4b574f13d/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:01.026868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.027429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.027846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.029528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1079/2180] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:01.032362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:01.047262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd3dc-e20b-412e-a6be-f638407a0b1d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:01.074817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] MFA Rules not processed for user `1a9fab364704412cb17369e4b574f13d`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:01.076788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:01.133418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:01.142949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:01.143833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.144058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.144399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.145311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:01.147920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.162911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1080/2181] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:01.166941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:01.169557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:01.178988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cbf2-f979-4cbb-93d5-a9d57eaa0ab1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:01.184654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5ce6-29d4-42ef-9cb4-29b650d751c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:01.186248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5ce6-29d4-42ef-9cb4-29b650d751c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.186550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1102/2182] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:01.186909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5ce6-29d4-42ef-9cb4-29b650d751c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.187263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5ce6-29d4-42ef-9cb4-29b650d751c2 admin admin] PATH_INFO: `/v3/projects/7670d93928e741f396ba611fb841bc86/users/d9535f39625b4c1893dc4533dc93a3df/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.196832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:01.198961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:01.206121 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5ce6-29d4-42ef-9cb4-29b650d751c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7670d93928e741f396ba611fb841bc86, user_id=d9535f39625b4c1893dc4533dc93a3df, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:01.209901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5ce6-29d4-42ef-9cb4-29b650d751c2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.229773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1081/2183] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:01 2022] PUT /identity/v3/projects/7670d93928e741f396ba611fb841bc86/users/d9535f39625b4c1893dc4533dc93a3df/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:01.235493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.235968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.236324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.263639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:01.264912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:01.272639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e800cd7-3a7f-43c7-8a2c-5f9f09fbddea None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:01.340841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:01.341993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.342272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.342540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.352723 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1082/2184] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:01.366179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:01.368439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:01.487231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424d105-1cdd-4dfc-b40f-78f641733528 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:01.489405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:01.492726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.500956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89c1e-975c-403b-9c57-d569fa13cf9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:01.502064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89c1e-975c-403b-9c57-d569fa13cf9a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.502351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89c1e-975c-403b-9c57-d569fa13cf9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.502623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89c1e-975c-403b-9c57-d569fa13cf9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.508911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1103/2185] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:01.522894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89c1e-975c-403b-9c57-d569fa13cf9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:01.530270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89c1e-975c-403b-9c57-d569fa13cf9a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.542090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1083/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:01.653048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:01.662738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e487d1-dbb5-4808-b0bb-9e28bb034c1c service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:01.674252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:01.674850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:01.675232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:01.675566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:01.682270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:01.905108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:01.909564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:01.923338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:01.934257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1104/2187] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:03.142843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:03.143465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:03.143751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:03.185229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] MFA Rules not processed for user `d9535f39625b4c1893dc4533dc93a3df`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:03.186694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:03.302221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:03.308353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1084/2188] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:03.327390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:03.330059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:03.343188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffb5a4-92f4-4054-9011-5f403b891060 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:03.348437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0e7fd-fd46-4dbb-8504-7121045cfd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:03.349017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e7fd-fd46-4dbb-8504-7121045cfd30 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:03.349300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e7fd-fd46-4dbb-8504-7121045cfd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:03.349710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e7fd-fd46-4dbb-8504-7121045cfd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:03.372306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0e7fd-fd46-4dbb-8504-7121045cfd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:03.375622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0e7fd-fd46-4dbb-8504-7121045cfd30 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:03.402564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1105/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:04.336949 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:04.339104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:04.369188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe47cb1-6197-48eb-bde9-e7d0dffd47fc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:04.383781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:04.384642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:04.385071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:04.385776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] PATH_INFO: `/v3/users/9a3fa120d6ef4836bd28abe827bd9ec9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:04.388986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3fa120d6ef4836bd28abe827bd9ec9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:04.391090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:04.490422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3fa120d6ef4836bd28abe827bd9ec9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:04.504281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3fa120d6ef4836bd28abe827bd9ec9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:04.505198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3fa120d6ef4836bd28abe827bd9ec9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:04.519140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3fa120d6ef4836bd28abe827bd9ec9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:04.520309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3fa120d6ef4836bd28abe827bd9ec9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:04.570225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1085/2190] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:04 2022] DELETE /identity/v3/users/9a3fa120d6ef4836bd28abe827bd9ec9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:04.575691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7115a-938f-4d79-a25c-d56bb616f858 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:04.576248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7115a-938f-4d79-a25c-d56bb616f858 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:04.576248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7115a-938f-4d79-a25c-d56bb616f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:04.621194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b2b7115a-938f-4d79-a25c-d56bb616f858 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:04.623788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b2b7115a-938f-4d79-a25c-d56bb616f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:04.736974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1106/2191] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:04.751977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:04.753863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:04.792751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2cdc9-2222-48d1-a3b9-c8d92ec1d799 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:04.793037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2cdc9-2222-48d1-a3b9-c8d92ec1d799 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:04.793472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2cdc9-2222-48d1-a3b9-c8d92ec1d799 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:04.794918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1107/2192] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:19:04.811354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636c09-0443-41e1-aba4-01a600053fb6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:04.811654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636c09-0443-41e1-aba4-01a600053fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:04.811958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94636c09-0443-41e1-aba4-01a600053fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:04.843993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-94636c09-0443-41e1-aba4-01a600053fb6 None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:04.845713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-94636c09-0443-41e1-aba4-01a600053fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:04.847348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f07bc-e605-43f0-84a1-04ed80306414 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:04.851828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:04.852682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:04.853656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:04.854043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:04.869618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:04.871650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:04.895509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1086/2193] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:04.953528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1108/2194] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:19:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:04.975557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:04.977687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:05.000961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985c56-01d7-4c23-9a20-854f8eba67b3 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:05.009649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:05.010607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:05.010991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:05.011274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:05.026831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:05.032372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:05.057654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1087/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:05.114411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:05.114550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:05.114851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:05.161279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] MFA Rules not processed for user `d9535f39625b4c1893dc4533dc93a3df`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:05.163247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:05.299977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1109/2196] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:06.255862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:06.257451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:06.288457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bcadc-fda5-4a62-8498-98e8851eb33d service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:06.304640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:06.305295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:06.305583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:06.305843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] PATH_INFO: `/v3/projects/ad4597e82beb489597db19233989551f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:06.312037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4597e82beb489597db19233989551f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:06.313989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:06.445722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4597e82beb489597db19233989551f', 'request_id': 'req-19f495af-e143-45c1-b65f-ae034fc493b4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.472948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4597e82beb489597db19233989551f', 'request_id': 'req-19f495af-e143-45c1-b65f-ae034fc493b4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.474744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:06.477515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:06.483475 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:06.499036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4597e82beb489597db19233989551f', 'request_id': 'req-19f495af-e143-45c1-b65f-ae034fc493b4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.507154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107e5b-09a7-4f77-abe7-ef269b86bd77 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:06.525516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] The token cache is being invalidate because project ad4597e82beb489597db19233989551f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:06.526135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.528417 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.534106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1088/2197] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:06 2022] DELETE /identity/v3/projects/ad4597e82beb489597db19233989551f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:06.538420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:06.540171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:06.576357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:06.645135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:06.646137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:06.646137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:06.646339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] PATH_INFO: `/v3/users/095de7205b514f0492e358a9f0649342` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:06.649227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095de7205b514f0492e358a9f0649342)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:06.651176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:06.693230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f495af-e143-45c1-b65f-ae034fc493b4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:06.704504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:06.705304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:06.705834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:06.706192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] PATH_INFO: `/v3/users/3ea453157e13456bb4c9eaa6bc80aa81` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:06.707729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea453157e13456bb4c9eaa6bc80aa81)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:06.709916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:06.790481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095de7205b514f0492e358a9f0649342'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.791343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095de7205b514f0492e358a9f0649342'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.816245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095de7205b514f0492e358a9f0649342'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.816245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095de7205b514f0492e358a9f0649342'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.825169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea453157e13456bb4c9eaa6bc80aa81'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.828849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095de7205b514f0492e358a9f0649342'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.854508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea453157e13456bb4c9eaa6bc80aa81'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.855993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea453157e13456bb4c9eaa6bc80aa81'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.879479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1110/2198] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:06 2022] DELETE /identity/v3/users/095de7205b514f0492e358a9f0649342 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:06.880418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:06.881446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea453157e13456bb4c9eaa6bc80aa81'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.882176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e93d898a-dc06-41a0-a2c7-c25911a3ece5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea453157e13456bb4c9eaa6bc80aa81'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:06.887727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:06.923058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1089/2199] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:06 2022] DELETE /identity/v3/users/3ea453157e13456bb4c9eaa6bc80aa81 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:07.038957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee3c92-1fa8-4783-bff7-199130533457 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:07.190738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:07.203592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:07.204405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:07.204835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:07.205112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] PATH_INFO: `/v3/users/fdd9d205c0404de2907e2776f0dc4281` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:07.207356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd9d205c0404de2907e2776f0dc4281)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:07.209439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:07.302378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db843ea-6dff-4149-a84b-1824c3fe7f12 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:07.302885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db843ea-6dff-4149-a84b-1824c3fe7f12 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:07.302885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db843ea-6dff-4149-a84b-1824c3fe7f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:07.315379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd9d205c0404de2907e2776f0dc4281'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.316311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd9d205c0404de2907e2776f0dc4281'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.326415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd9d205c0404de2907e2776f0dc4281'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.329154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd9d205c0404de2907e2776f0dc4281'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.352174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd9d205c0404de2907e2776f0dc4281'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.352652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1db843ea-6dff-4149-a84b-1824c3fe7f12 None None] MFA Rules not processed for user `6b206c654b8f402785a06c31dd36ca40`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:07.354883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1db843ea-6dff-4149-a84b-1824c3fe7f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.430608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1111/2200] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:06 2022] DELETE /identity/v3/users/fdd9d205c0404de2907e2776f0dc4281 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:07.431771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:07.435527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.521555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:07.550444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1090/2201] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:07.554189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:07.554716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:07.555067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:07.580067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:07.581691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.594692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1091/2202] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:07.596332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:07.599216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbc575-58f6-4978-9aa4-f8b1b7473127 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:07.604406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:07.605504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:07.605833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:07.606035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] PATH_INFO: `/v3/projects/790a1b2e39704167ba3e0ed8c9f28290` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:07.606137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.607722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790a1b2e39704167ba3e0ed8c9f28290)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:07.610759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:07.673573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790a1b2e39704167ba3e0ed8c9f28290', 'request_id': 'req-3397b942-ceee-42b5-a1ae-c04714b73ea5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.689258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790a1b2e39704167ba3e0ed8c9f28290', 'request_id': 'req-3397b942-ceee-42b5-a1ae-c04714b73ea5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.707718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790a1b2e39704167ba3e0ed8c9f28290', 'request_id': 'req-3397b942-ceee-42b5-a1ae-c04714b73ea5'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.726821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] The token cache is being invalidate because project 790a1b2e39704167ba3e0ed8c9f28290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:07.728313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.731103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:07.735786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1112/2203] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:07 2022] DELETE /identity/v3/projects/790a1b2e39704167ba3e0ed8c9f28290 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:07.736937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:07.739784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.752629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:07.774018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7bf7b-3ab7-42c5-9ff2-40ecc439fbb6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:07.854786 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397b942-ceee-42b5-a1ae-c04714b73ea5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:07.860922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:07.861734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:07.862195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:07.862646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:07.866064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.878555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:07.879414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:07.879768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:07.880268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:07.882862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.965403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:07.967725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:07.973542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:07.975893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:07.995770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1092/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:07.996697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:07.998877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:07.999160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1113/2205] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:08.000230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:08.001818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:08.014722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df60a-498a-4629-91d1-f80c4cf22fea service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:08.018218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090376b0-ddda-464c-a275-8d5f13af3fa2 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:08.020177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:08.020936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:08.021404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:08.021772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] PATH_INFO: `/v3/projects/1449507328c14ba8b4e70217a5351cb5` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:08.023051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1449507328c14ba8b4e70217a5351cb5)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:08.026104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:08.039153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:08.039827 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:08.040136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:08.040544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] PATH_INFO: `/v3/users/b0b2f8748a8d4d9486c73a932462c332` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:08.045294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b2f8748a8d4d9486c73a932462c332)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:08.049688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:08.096632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:08.102316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1449507328c14ba8b4e70217a5351cb5', 'request_id': 'req-82951509-1b2a-46de-b729-7e5ec34aac56'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.116636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1449507328c14ba8b4e70217a5351cb5', 'request_id': 'req-82951509-1b2a-46de-b729-7e5ec34aac56'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.134929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1449507328c14ba8b4e70217a5351cb5', 'request_id': 'req-82951509-1b2a-46de-b729-7e5ec34aac56'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.154372 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] The token cache is being invalidate because project 1449507328c14ba8b4e70217a5351cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:08.154804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.155591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.157787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1114/2206] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:07 2022] DELETE /identity/v3/projects/1449507328c14ba8b4e70217a5351cb5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:08.174978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b2f8748a8d4d9486c73a932462c332'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.175857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:08.177748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:08.197593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b2f8748a8d4d9486c73a932462c332'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.198310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b2f8748a8d4d9486c73a932462c332'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.211258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b2f8748a8d4d9486c73a932462c332'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.212705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b2f8748a8d4d9486c73a932462c332'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.247643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1093/2207] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:07 2022] DELETE /identity/v3/users/b0b2f8748a8d4d9486c73a932462c332 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:08.248207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:08.302822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82951509-1b2a-46de-b729-7e5ec34aac56 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:08.416123 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:08.416687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:08.416993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:08.417650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] PATH_INFO: `/v3/users/753826bba55645c39881a6e712805333` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:08.419908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753826bba55645c39881a6e712805333)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:08.422622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:08.504340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753826bba55645c39881a6e712805333'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.505422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753826bba55645c39881a6e712805333'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.515416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753826bba55645c39881a6e712805333'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.516716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753826bba55645c39881a6e712805333'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.526624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753826bba55645c39881a6e712805333'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:08.552520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1115/2208] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:08 2022] DELETE /identity/v3/users/753826bba55645c39881a6e712805333 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:08.949956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:08.955654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:08.985894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea5c0-4153-4784-b756-656a4efcf0ff admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:09.176459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:09.178376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:09.220756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:09.222331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.222718 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.223207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] PATH_INFO: `/v3/projects/0e8c5e5a0d8444809a642759d5085172` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.224704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8c5e5a0d8444809a642759d5085172)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:09.227860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:09.307659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df49ce-bac3-469b-8627-9f9c8c38a966 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:09.324012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:09.327879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8c5e5a0d8444809a642759d5085172', 'request_id': 'req-474a514c-32dc-461c-9042-c8fe03eb2998'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.344203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8c5e5a0d8444809a642759d5085172', 'request_id': 'req-474a514c-32dc-461c-9042-c8fe03eb2998'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.359879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8c5e5a0d8444809a642759d5085172', 'request_id': 'req-474a514c-32dc-461c-9042-c8fe03eb2998'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.378424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] The token cache is being invalidate because project 0e8c5e5a0d8444809a642759d5085172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:09.378712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.381203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-474a514c-32dc-461c-9042-c8fe03eb2998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.384021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1094/2209] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:08 2022] DELETE /identity/v3/projects/0e8c5e5a0d8444809a642759d5085172 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:09.389989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091dedd-3ced-4d35-bc36-953edeb53c71 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.390341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091dedd-3ced-4d35-bc36-953edeb53c71 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.390675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091dedd-3ced-4d35-bc36-953edeb53c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.433047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9091dedd-3ced-4d35-bc36-953edeb53c71 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:09.437412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9091dedd-3ced-4d35-bc36-953edeb53c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:09.465535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:09.479250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:09.479920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.480309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.480584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] PATH_INFO: `/v3/projects/56ce76de2bfd49489f901787f01d6f6b` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.481837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ce76de2bfd49489f901787f01d6f6b)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:09.484491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:09.562789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1095/2210] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:09.563866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.564381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.564757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.571610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ce76de2bfd49489f901787f01d6f6b', 'request_id': 'req-b272bbbd-398a-4a8a-83ac-f61a73bc733a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.604009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ce76de2bfd49489f901787f01d6f6b', 'request_id': 'req-b272bbbd-398a-4a8a-83ac-f61a73bc733a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.608001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:09.610756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:09.623501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ce76de2bfd49489f901787f01d6f6b', 'request_id': 'req-b272bbbd-398a-4a8a-83ac-f61a73bc733a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.658639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] The token cache is being invalidate because project 56ce76de2bfd49489f901787f01d6f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:09.659899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.674436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:09.681873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1116/2211] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:09 2022] DELETE /identity/v3/projects/56ce76de2bfd49489f901787f01d6f6b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:09.699866 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:09.707196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:09.799533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1096/2212] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:09.804173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:09.816881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86210a-2408-4d0f-bcfa-e7bd38b593dc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:09.833100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:09.837212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.837718 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.838188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.842832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:09.844629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:09.846484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:09.878752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1097/2213] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:19:09.883439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:09.903559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be58b0-c99d-4f5d-8945-d41ab843eae5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:09.915325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272bbbd-398a-4a8a-83ac-f61a73bc733a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:09.916614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:09.917292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.917682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.917961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.918609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:09.922579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:09.928135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:09.929503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:09.930199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:09.930485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] PATH_INFO: `/v3/users/1a9fab364704412cb17369e4b574f13d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:09.933536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9fab364704412cb17369e4b574f13d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:09.938343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:09.982551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1098/2214] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:09 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:09.987080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:10.030207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:10.036369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9fab364704412cb17369e4b574f13d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.037735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9fab364704412cb17369e4b574f13d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.064542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9fab364704412cb17369e4b574f13d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.065545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9fab364704412cb17369e4b574f13d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.089239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9fab364704412cb17369e4b574f13d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.139631 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1117/2215] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:09 2022] DELETE /identity/v3/users/1a9fab364704412cb17369e4b574f13d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:10.143166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323756b-9deb-41f6-ad04-10f251c1882f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:10.183041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:10.184527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:10.244593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:10.308428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:10.309128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.309392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.309664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.310347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:10.312392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:10.320323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd152348-7cb0-4580-b977-9a2fe71d2aba admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:10.329061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:10.330057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.330490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.332202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] PATH_INFO: `/v3/projects/3344814c7bf447eabdf907031417d37c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.334330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3344814c7bf447eabdf907031417d37c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:10.357644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:10.378788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1099/2216] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:09 2022] POST /identity/v3/users => generated 292 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:10.379907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:10.382071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:10.401316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991680-16a9-4f28-ad17-961584d417d1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:10.418285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:10.418823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.419601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.419889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.420890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:10.422629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:10.451451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1100/2217] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:10.452416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:10.473968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82261781-1c31-41a9-982d-1add9d66aa56 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:10.482248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3344814c7bf447eabdf907031417d37c', 'request_id': 'req-63867159-d17d-4f79-a28d-7c0b1c326929'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.499424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3344814c7bf447eabdf907031417d37c', 'request_id': 'req-63867159-d17d-4f79-a28d-7c0b1c326929'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.508040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3344814c7bf447eabdf907031417d37c', 'request_id': 'req-63867159-d17d-4f79-a28d-7c0b1c326929'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.534208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] The token cache is being invalidate because project 3344814c7bf447eabdf907031417d37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:10.534758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.535613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:10.537729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1118/2218] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:10 2022] DELETE /identity/v3/projects/3344814c7bf447eabdf907031417d37c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:10.681470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:10.682199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.682628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.683136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.684547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:10.688807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:10.706578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1101/2219] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:10.710141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:10.712159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:10.734621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63867159-d17d-4f79-a28d-7c0b1c326929 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:10.751763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76338d3a-4f67-4efe-b820-88fc2708e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:10.752583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76338d3a-4f67-4efe-b820-88fc2708e5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.753140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76338d3a-4f67-4efe-b820-88fc2708e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.753524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76338d3a-4f67-4efe-b820-88fc2708e5d8 admin admin] PATH_INFO: `/v3/projects/1bc13fdda5934990b52d365c21bc0e16/users/f435ba068beb444eb8344302ac6be56b/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.782118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76338d3a-4f67-4efe-b820-88fc2708e5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc13fdda5934990b52d365c21bc0e16, user_id=f435ba068beb444eb8344302ac6be56b, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:10.782837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:10.784880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:10.785002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76338d3a-4f67-4efe-b820-88fc2708e5d8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:10.811703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95449304-7291-4da7-be27-de2cb47d4a17 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:10.829010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1119/2220] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:10 2022] PUT /identity/v3/projects/1bc13fdda5934990b52d365c21bc0e16/users/f435ba068beb444eb8344302ac6be56b/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:10.834235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.834946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.834946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.882442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] MFA Rules not processed for user `f435ba068beb444eb8344302ac6be56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:10.883838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:10.913009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:10.914057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:10.914575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:10.914947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] PATH_INFO: `/v3/users/41b6592ae2e74709a0a571d96bf2b9ef` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:10.916409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b6592ae2e74709a0a571d96bf2b9ef)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:10.918306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:10.919776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:11.004720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b6592ae2e74709a0a571d96bf2b9ef'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.023307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b6592ae2e74709a0a571d96bf2b9ef'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.024291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b6592ae2e74709a0a571d96bf2b9ef'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.035877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:11.069258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1120/2221] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:11.069799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b6592ae2e74709a0a571d96bf2b9ef'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.075642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b6592ae2e74709a0a571d96bf2b9ef'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.099750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:11.107713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.143548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1102/2222] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:10 2022] DELETE /identity/v3/users/41b6592ae2e74709a0a571d96bf2b9ef => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:11.146171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:11.148937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.157442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7a57-3af1-4fd1-9bd9-66f4d4ab87d1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:11.272008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77079-d6ee-4692-9841-1ddc318b8a6f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:11.277153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:11.278642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:11.279110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.279559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.279955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.280325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] PATH_INFO: `/v3/projects/7ac7175f3b004815898829732aa3bb85` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.281648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac7175f3b004815898829732aa3bb85)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:11.283062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.283429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.284020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:11.285611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.393777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:11.396935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b991570-482d-498f-a0b4-30ef2e9604bf service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:11.406677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac7175f3b004815898829732aa3bb85', 'request_id': 'req-823bf428-28ee-4551-8369-7c4f7095188e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.420217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac7175f3b004815898829732aa3bb85', 'request_id': 'req-823bf428-28ee-4551-8369-7c4f7095188e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.428438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1103/2223] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:11.430000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5089ed3-d497-426a-94a3-8bda3c3d0178 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.433382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5089ed3-d497-426a-94a3-8bda3c3d0178 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.433697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5089ed3-d497-426a-94a3-8bda3c3d0178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.455033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac7175f3b004815898829732aa3bb85', 'request_id': 'req-823bf428-28ee-4551-8369-7c4f7095188e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.478623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] The token cache is being invalidate because project 7ac7175f3b004815898829732aa3bb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:11.479000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.481478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-823bf428-28ee-4551-8369-7c4f7095188e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:11.488045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1121/2224] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:11 2022] DELETE /identity/v3/projects/7ac7175f3b004815898829732aa3bb85 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:11.488045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.488290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.488913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.490305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f5089ed3-d497-426a-94a3-8bda3c3d0178 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:11.492118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f5089ed3-d497-426a-94a3-8bda3c3d0178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.540047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] MFA Rules not processed for user `6b206c654b8f402785a06c31dd36ca40`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:11.544425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.630084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1104/2225] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:11.634454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb8c0-8f96-4518-9e1b-e52350e9d312 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.634744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb8c0-8f96-4518-9e1b-e52350e9d312 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.635328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb8c0-8f96-4518-9e1b-e52350e9d312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.638518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:11.677671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1122/2226] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:11.692156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:11.692156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.707001 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-20ebb8c0-8f96-4518-9e1b-e52350e9d312 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:11.708292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20ebb8c0-8f96-4518-9e1b-e52350e9d312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.728831 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1105/2227] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:11.736441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.736806 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.737152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.766146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:11.767693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:11.801599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e1a08-87e4-4986-aa17-d40c94e9dd32 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:11.807234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1106/2228] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:11.811167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:11.817307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:11.818365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.819168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.822080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.833158 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95e96-acc6-4b6f-ba98-6420c089873c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:11.841833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:11.842714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.843098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.843537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.844465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:11.844871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:11.846856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:11.860741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:11.861348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:11.862539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:11.876215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1107/2229] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:11.876418 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1123/2230] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:11.879058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:11.897395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef185-fc09-4c8a-b471-503cd9191b3b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:11.917201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:11.917825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:11.918101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:11.918368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:11.918993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:11.922204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:11.979641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1108/2231] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:11 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:11.985027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.001309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cef81-7c8a-42e9-826d-ca528830254e service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.103643 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.104307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.104905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.104905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.106125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.109316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.134214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1124/2232] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:11 2022] POST /identity/v3/users => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:12.139520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.154980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f360f-7fe6-41aa-9d70-80202f5eb638 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.160802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.161632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.162451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.162912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.164561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.166387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.181168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1109/2233] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:12.185226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.196443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1ee34-175c-4e01-aede-4e6e5a5cc45f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.204170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8911de-f0e4-4922-b432-b14c6923e081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.204792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8911de-f0e4-4922-b432-b14c6923e081 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.205065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8911de-f0e4-4922-b432-b14c6923e081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.205332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8911de-f0e4-4922-b432-b14c6923e081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.205985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8911de-f0e4-4922-b432-b14c6923e081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.207780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8911de-f0e4-4922-b432-b14c6923e081 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.221881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1125/2234] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:12.224362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.236061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932ef2-e63c-40b9-a369-2a1fd060ccb6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.242266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.243292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.243527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.243836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] PATH_INFO: `/v3/projects/fc9413673e83422ab0b8bcd547b92633/users/275e8f7016c34fed94156e6b9da2581a/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.263500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9413673e83422ab0b8bcd547b92633, user_id=275e8f7016c34fed94156e6b9da2581a, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.266292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.282032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1110/2235] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:12 2022] PUT /identity/v3/projects/fc9413673e83422ab0b8bcd547b92633/users/275e8f7016c34fed94156e6b9da2581a/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:12.294885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.294885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.295593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.335177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] MFA Rules not processed for user `275e8f7016c34fed94156e6b9da2581a`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:12.336536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:12.428334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1126/2236] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:12.432866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.508420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d08a-4e9b-447c-bd00-91035dcd4729 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.513824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.514467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.514705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.514983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.515623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.517574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.551387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1111/2237] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:12 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:12.555518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.562160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:12.568406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566bc49-1d70-4e11-a96b-d52a6b3860ba None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.638975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.639604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.639883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.640181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.640815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.642877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.673060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1127/2238] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:12 2022] POST /identity/v3/users => generated 307 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:12.677199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.689349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fadba-58cc-421a-ba25-39291e576f97 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.694966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.695615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.696150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.696539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.697437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.699507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.713847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1112/2239] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:12.715371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.715495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.717715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:12.736507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc70f-d29c-4ffa-9799-ec68b4840cf7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.741960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.743027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.745556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.746015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] PATH_INFO: `/v3/projects/e623b8ea0b0d4d40b87e32cdd61975a2/users/4a7437dcc59d44e78b47233f4f0445c7/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.749279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d607-51aa-4f62-a33b-68eb50142394 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:12.755501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:12.760932 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.761281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.761636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] PATH_INFO: `/v3/projects/bb5a37fbdc80434d881af75db74f1385` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.763258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5a37fbdc80434d881af75db74f1385)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.766847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.785658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e623b8ea0b0d4d40b87e32cdd61975a2, user_id=4a7437dcc59d44e78b47233f4f0445c7, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:12.789601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:12.812873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1113/2240] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:12 2022] PUT /identity/v3/projects/e623b8ea0b0d4d40b87e32cdd61975a2/users/4a7437dcc59d44e78b47233f4f0445c7/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:12.817648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:12.834615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5a37fbdc80434d881af75db74f1385', 'request_id': 'req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:12.843720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5a37fbdc80434d881af75db74f1385', 'request_id': 'req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:12.853257 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5a37fbdc80434d881af75db74f1385', 'request_id': 'req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:12.867979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] The token cache is being invalidate because project bb5a37fbdc80434d881af75db74f1385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:12.868329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:12.869549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-af1885d1-1fa3-4580-98cf-cfd68b13cdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:12.871546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1128/2241] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:12 2022] DELETE /identity/v3/projects/bb5a37fbdc80434d881af75db74f1385 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:12.878267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4a6a-1757-4f9f-9c61-919bf07485aa None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:12.878675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4a6a-1757-4f9f-9c61-919bf07485aa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:12.879233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4a6a-1757-4f9f-9c61-919bf07485aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:12.900199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:12.913962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cbda4a6a-1757-4f9f-9c61-919bf07485aa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:12.916008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cbda4a6a-1757-4f9f-9c61-919bf07485aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:12.929131 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abd10-a5ec-48c9-aacc-a058eb231f29 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.027040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1129/2242] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:13.036455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.036455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.036455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.053980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.055815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.056288 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.056709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.057510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.058808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:13.060159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.060780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:13.071158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1130/2243] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:13.075343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.077514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1114/2244] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:13.081225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.084388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:13.087139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad9e1-bce0-4df9-9fca-5c7f02784322 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.093512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.094604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.095468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.095755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.096617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:13.097685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.099574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.110323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027efa8e-e2ae-473b-ac02-449c40890c3c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.111416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:13.131983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1131/2245] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:13.133011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.135599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c2dbc-db2f-474f-8b7e-cfe06b909ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.136582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2dbc-db2f-474f-8b7e-cfe06b909ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.137051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2dbc-db2f-474f-8b7e-cfe06b909ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.137624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c2dbc-db2f-474f-8b7e-cfe06b909ae3 admin admin] PATH_INFO: `/v3/projects/e623b8ea0b0d4d40b87e32cdd61975a2/users/4a7437dcc59d44e78b47233f4f0445c7/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.141062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2dbc-db2f-474f-8b7e-cfe06b909ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e623b8ea0b0d4d40b87e32cdd61975a2, user_id=4a7437dcc59d44e78b47233f4f0445c7, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.149095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c2dbc-db2f-474f-8b7e-cfe06b909ae3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.167388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1115/2246] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:13 2022] PUT /identity/v3/projects/e623b8ea0b0d4d40b87e32cdd61975a2/users/4a7437dcc59d44e78b47233f4f0445c7/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:13.174898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a68982-ff77-4d90-8032-e466e961e12b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.178757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.179229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.179508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.227508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] MFA Rules not processed for user `4a7437dcc59d44e78b47233f4f0445c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:13.228734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:13.311071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.312318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.313065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.313624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.316044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.318019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.361773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1132/2247] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:13 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:13.366338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.428212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1116/2248] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:13.441309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.445916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:13.514026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13e4a-0468-422b-9b9f-0d983afaeec5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.528981 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.529407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.529709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.529940 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.530590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.534113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.581778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1133/2249] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:13 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:13.585995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.610525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bfed8-3799-4b46-af96-9d75af2bc53d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.616861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.618520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.618819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.619138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.621526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.624140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.642531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1134/2250] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:13.647247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.663724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e65ce-e68f-4728-b31f-927eb9ad353f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.671305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.671776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.672243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.672772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.673774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.674243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0034-e814-4a6d-98ae-6214135b735e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.676032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.694041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1135/2251] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:13.699849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.716556 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724da94-0136-44e2-bf7c-554ffbc8133a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.720032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:13.726541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19a7b-9856-4199-837d-642970a5c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.728358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19a7b-9856-4199-837d-642970a5c0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.728985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19a7b-9856-4199-837d-642970a5c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.729303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19a7b-9856-4199-837d-642970a5c0d4 admin admin] PATH_INFO: `/v3/projects/72dc0217054b4588867ad1431b3a7441/users/7435657ffd3a42fc9a52c551e418e7a1/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.749876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19a7b-9856-4199-837d-642970a5c0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dc0217054b4588867ad1431b3a7441, user_id=7435657ffd3a42fc9a52c551e418e7a1, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.753026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19a7b-9856-4199-837d-642970a5c0d4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.761786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:13.762584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.763007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.763275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.772496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1136/2252] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:13 2022] PUT /identity/v3/projects/72dc0217054b4588867ad1431b3a7441/users/7435657ffd3a42fc9a52c551e418e7a1/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:13.784668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:13.784938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:13.785208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:13.834029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] MFA Rules not processed for user `7435657ffd3a42fc9a52c551e418e7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:13.835310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:13.851076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:13.864527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:13.866167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:13.876947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1117/2253] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:13.931532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1137/2254] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:13.940513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.949817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f53dd-bfa1-4d49-a937-be91a7a3f8cc service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:13.974090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:13.975750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:14.004195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:14.004887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:14.005251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:14.005678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:14.016851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:14.019182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:14.031032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1118/2255] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:14.074905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccad550-2dc7-4a47-bdf3-eefba4010b96 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:14.079991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:14.080608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:14.080883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:14.081152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:14.083490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:14.161647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:14.163276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5876ca-5fa1-46db-9d16-9bb8d4ba3e71 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:14.176112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1138/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:17.387067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:17.390170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:17.560347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09a42d-35e9-4e31-8cbd-7307f1901ae6 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:17.593535 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:17.595926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:17.596838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:17.600716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] PATH_INFO: `/v3/users/f435ba068beb444eb8344302ac6be56b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:17.605559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f435ba068beb444eb8344302ac6be56b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:17.608297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:17.664457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:17.755682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f435ba068beb444eb8344302ac6be56b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:17.768456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f435ba068beb444eb8344302ac6be56b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:17.769403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f435ba068beb444eb8344302ac6be56b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:17.798612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f435ba068beb444eb8344302ac6be56b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:17.808058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f435ba068beb444eb8344302ac6be56b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:17.858403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1119/2257] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:17 2022] DELETE /identity/v3/users/f435ba068beb444eb8344302ac6be56b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:17.862780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:17.863260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:17.863347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:17.897617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:17.900583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:17.979577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1139/2258] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:17.990072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:17.991656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.052335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f7e0-d0f8-4e8e-9ae3-4b1f3a77ebc7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:18.056052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116153-4d5a-49e9-baae-3145374245ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:18.056681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116153-4d5a-49e9-baae-3145374245ed service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.057145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116153-4d5a-49e9-baae-3145374245ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.057414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116153-4d5a-49e9-baae-3145374245ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.068299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116153-4d5a-49e9-baae-3145374245ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:18.069671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116153-4d5a-49e9-baae-3145374245ed service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:18.079449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1120/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:18.404100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:18.406235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.420479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2b5c6-a6c8-49d6-b60e-97f7e846e148 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:18.429278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:18.429943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.435582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.435958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] PATH_INFO: `/v3/projects/1bc13fdda5934990b52d365c21bc0e16` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.440436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc13fdda5934990b52d365c21bc0e16)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:18.443022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:18.446934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:18.512237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc13fdda5934990b52d365c21bc0e16', 'request_id': 'req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.523677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc13fdda5934990b52d365c21bc0e16', 'request_id': 'req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.533949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc13fdda5934990b52d365c21bc0e16', 'request_id': 'req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.554766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] The token cache is being invalidate because project 1bc13fdda5934990b52d365c21bc0e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:18.555110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.560444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.564557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1140/2260] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:18 2022] DELETE /identity/v3/projects/1bc13fdda5934990b52d365c21bc0e16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:18.570683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9306ec0-5492-49a7-aaad-5f3b8b1f8d90 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.571155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9306ec0-5492-49a7-aaad-5f3b8b1f8d90 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.571251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9306ec0-5492-49a7-aaad-5f3b8b1f8d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.593135 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f9306ec0-5492-49a7-aaad-5f3b8b1f8d90 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:18.594585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f9306ec0-5492-49a7-aaad-5f3b8b1f8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.649287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:18.650776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.720084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1121/2261] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:18.722588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.723000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.723289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.753100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc6084-7b6e-43c4-bfbe-fff082c6cd06 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:18.754816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:18.756499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.767068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:18.767975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1122/2262] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:18.768847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.769345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.769897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] PATH_INFO: `/v3/users/275e8f7016c34fed94156e6b9da2581a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.771341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:18.776674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=275e8f7016c34fed94156e6b9da2581a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:18.780679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:18.781564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b4e62-3efb-433b-8ea6-de1b55253a96 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:18.788335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:18.788956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.789230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.790307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.791112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:18.791471 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:18.793598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:18.810771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1123/2263] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:18.815537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:18.838147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0999f8-28d9-4173-983f-35eb1dbe8705 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:18.846081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:18.847851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.848682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.848682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.849826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:18.852528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275e8f7016c34fed94156e6b9da2581a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.852801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:18.853843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275e8f7016c34fed94156e6b9da2581a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.864468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275e8f7016c34fed94156e6b9da2581a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.866308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275e8f7016c34fed94156e6b9da2581a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.883423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ca626267-00e7-4d6d-ac3d-259e17f8e25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275e8f7016c34fed94156e6b9da2581a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:18.888117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:18.903964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1124/2264] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:18 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:18.906120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:18.908583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.915891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1141/2265] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:18 2022] DELETE /identity/v3/users/275e8f7016c34fed94156e6b9da2581a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:18.921668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:18.922788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:18.923144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:18.971919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:18.974059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:18.983342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:19.047119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194059-0f07-4864-8eff-12288f7b82af admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.061526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1142/2266] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:19.076410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.078845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:19.121491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.123181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.123590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.124023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.124818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.127816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.150784 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945c089-0b38-4198-8149-e133defce3c2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.155457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.156054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.156336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.156610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.157265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1125/2267] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:18 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:19.161424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.171258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.172894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.183261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587640f-8200-47a8-a615-f2e99647504a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.183414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1143/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:19.188464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.189454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.189454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.189752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.190608 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.192796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.207974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1126/2269] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:19.210589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.228274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687d60a-f1f6-4764-84e0-16a47194c2fb service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.236053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4f6f-5b52-478c-9a36-b2f70f3b6623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.237129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4f6f-5b52-478c-9a36-b2f70f3b6623 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.237511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4f6f-5b52-478c-9a36-b2f70f3b6623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.238501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4f6f-5b52-478c-9a36-b2f70f3b6623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.240140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4f6f-5b52-478c-9a36-b2f70f3b6623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.243526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4f6f-5b52-478c-9a36-b2f70f3b6623 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.264309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1144/2270] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:19.265621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.276560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22aa26-d615-490b-ab43-62155e33295c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.283407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.284395 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.284872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.285126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] PATH_INFO: `/v3/projects/6590276b307d49eabc3626b48a453e69/users/632d276721ae48e29ff8285dc99ce6c1/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.303587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6590276b307d49eabc3626b48a453e69, user_id=632d276721ae48e29ff8285dc99ce6c1, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.306611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.322583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1127/2271] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:19 2022] PUT /identity/v3/projects/6590276b307d49eabc3626b48a453e69/users/632d276721ae48e29ff8285dc99ce6c1/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:19.334765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.335056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.335353 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.364606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] MFA Rules not processed for user `632d276721ae48e29ff8285dc99ce6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:19.365903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:19.435301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1145/2272] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:19.447082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.448927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:19.503625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.505486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:19.516856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9b33-debc-4dac-917c-fe0cf1ef636c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.523170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.523870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.524258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.525247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.539241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.542393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.552031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:19.556706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1128/2273] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:19.586694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aae7b-55b6-442d-bee2-304a2fa9b3c8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.592802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.593438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.593792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.594244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] PATH_INFO: `/v3/projects/fc9413673e83422ab0b8bcd547b92633` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.595388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9413673e83422ab0b8bcd547b92633)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.597597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.650769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9413673e83422ab0b8bcd547b92633', 'request_id': 'req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.661384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9413673e83422ab0b8bcd547b92633', 'request_id': 'req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.668274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9413673e83422ab0b8bcd547b92633', 'request_id': 'req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.678828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] The token cache is being invalidate because project fc9413673e83422ab0b8bcd547b92633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:19.679036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.679695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.681320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1146/2274] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:19 2022] DELETE /identity/v3/projects/fc9413673e83422ab0b8bcd547b92633 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:19.685725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:19.691298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:19.697976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bf2a8-1bb2-473e-8566-f7072ace68a8 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:19.760877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:19.761510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:19.761782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:19.762050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] PATH_INFO: `/v3/users/4a7437dcc59d44e78b47233f4f0445c7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:19.764035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7437dcc59d44e78b47233f4f0445c7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:19.766049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:19.859962 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7437dcc59d44e78b47233f4f0445c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.870587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7437dcc59d44e78b47233f4f0445c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.873014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7437dcc59d44e78b47233f4f0445c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.891688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7437dcc59d44e78b47233f4f0445c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.892565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f63cad6-12c1-425c-aa14-3ed0dffdbb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7437dcc59d44e78b47233f4f0445c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:19.927225 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1129/2275] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:19 2022] DELETE /identity/v3/users/4a7437dcc59d44e78b47233f4f0445c7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:20.324585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:20.337650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:20.355480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9cf88-5fd4-42aa-8f17-ab890b72196d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:20.435546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:20.436357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.436774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.437138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] PATH_INFO: `/v3/projects/e623b8ea0b0d4d40b87e32cdd61975a2` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.438565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e623b8ea0b0d4d40b87e32cdd61975a2)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:20.443411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:20.508947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e623b8ea0b0d4d40b87e32cdd61975a2', 'request_id': 'req-0228f715-d9e1-49f9-aec6-d4cf17b0719a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:20.518457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e623b8ea0b0d4d40b87e32cdd61975a2', 'request_id': 'req-0228f715-d9e1-49f9-aec6-d4cf17b0719a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:20.525776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e623b8ea0b0d4d40b87e32cdd61975a2', 'request_id': 'req-0228f715-d9e1-49f9-aec6-d4cf17b0719a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:20.530520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:20.548779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] The token cache is being invalidate because project e623b8ea0b0d4d40b87e32cdd61975a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:20.549410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:20.550527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0228f715-d9e1-49f9-aec6-d4cf17b0719a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:20.555918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1147/2276] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:20 2022] DELETE /identity/v3/projects/e623b8ea0b0d4d40b87e32cdd61975a2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:20.561944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.562273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.562632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.596315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:20.597561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:20.677973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1130/2277] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:20.686548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.686914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.687338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.717026 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:20.718347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:20.736237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1148/2278] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:20.737181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:20.747433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdec7e-8bc4-4309-8bae-1f91fa3d4e0c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:20.753629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:20.754248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.754573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.754978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.755497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:20.755799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:20.757499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:20.771340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1131/2279] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:19:20.776636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:20.787926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099e76-4cd3-464d-bf79-f7b0a937e6d8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:20.793479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:20.794773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.795051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.795373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.796039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:20.798037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:20.832560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1149/2280] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:20 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:20.836672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:20.849129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64ea9e-8070-4bfe-a905-08e1e1cae07c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:20.855478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:20.915448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:20.916084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.916381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.916769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.917423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:20.919991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:20.953274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:20.963356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1132/2281] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:20 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:20.978967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bfa17-6442-408b-91bf-2623b6b7e01d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:20.982954 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:20.984005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:20.984367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:20.984707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:20.985431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:20.987419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.007581 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1150/2282] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:21.008879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.025638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a529b3c-c87d-4a57-a71e-a171b1dc7c32 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.032353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef19d-3ca4-4bd1-9f34-703530b34dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.034380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef19d-3ca4-4bd1-9f34-703530b34dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.035748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef19d-3ca4-4bd1-9f34-703530b34dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.036385 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef19d-3ca4-4bd1-9f34-703530b34dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.037468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ef19d-3ca4-4bd1-9f34-703530b34dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.040414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ef19d-3ca4-4bd1-9f34-703530b34dfb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.072675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.073594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1133/2283] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:21.093824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e4f1-b46e-46c6-b060-eb421afc251b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.111310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.112350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.112350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.114057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] PATH_INFO: `/v3/projects/91fb2cea17c046958de7f57ec83bc108/users/dc105f33cb2149cfb65770942fea7d39/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.136717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fb2cea17c046958de7f57ec83bc108, user_id=dc105f33cb2149cfb65770942fea7d39, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.143005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.161692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1151/2284] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:21 2022] PUT /identity/v3/projects/91fb2cea17c046958de7f57ec83bc108/users/dc105f33cb2149cfb65770942fea7d39/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:21.175568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.175856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.176147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.240368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] MFA Rules not processed for user `dc105f33cb2149cfb65770942fea7d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:21.242224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:21.382702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1134/2285] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:21.387610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.491076 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30283b-2ac6-4c95-bd8c-4c867128ff62 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.497989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.499034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.499419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.499964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.500751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.504646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.562885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1152/2286] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:21 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:21.566891 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.585105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66d45-9a4d-4936-82f2-f0bb8b81ddbf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.685239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.686324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.687210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.687576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.688375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.691519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.746744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1135/2287] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:21 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:21.751217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.764324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d9385-b524-49d0-a6cc-70ae623da478 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.769296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.770310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.770310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.770507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.771074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.772810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.783848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1153/2288] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:21.788286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.800312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393e8b-4527-4af9-966b-a1d5b97df649 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.806128 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.806802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.807068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.807337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] PATH_INFO: `/v3/projects/45c94ddec3ad4ab5b70c6cdeca713c35/users/d9096ab3645a4eb1b39dcbba3a7511c1/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.810360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:21.826878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c94ddec3ad4ab5b70c6cdeca713c35, user_id=d9096ab3645a4eb1b39dcbba3a7511c1, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.830017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.847770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1136/2289] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:21 2022] PUT /identity/v3/projects/45c94ddec3ad4ab5b70c6cdeca713c35/users/d9096ab3645a4eb1b39dcbba3a7511c1/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:21.851987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.863607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd96acb-cd88-4a0e-83be-10346e1bbfdc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:21.950728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439ab65-f8ee-41be-9a7a-64581c5993cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:21.951459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439ab65-f8ee-41be-9a7a-64581c5993cc admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:21.951910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439ab65-f8ee-41be-9a7a-64581c5993cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:21.952220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439ab65-f8ee-41be-9a7a-64581c5993cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:21.953028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439ab65-f8ee-41be-9a7a-64581c5993cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:21.954824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439ab65-f8ee-41be-9a7a-64581c5993cc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:21.961474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:21.974170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:21.975284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1154/2290] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:22.015832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d176ba-9200-415a-a853-1c558667508a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:22.021487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:22.022406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:22.022828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:22.023239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] PATH_INFO: `/v3/projects/45c94ddec3ad4ab5b70c6cdeca713c35/users/d9096ab3645a4eb1b39dcbba3a7511c1/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:22.025812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c94ddec3ad4ab5b70c6cdeca713c35, user_id=d9096ab3645a4eb1b39dcbba3a7511c1, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:22.030211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:22.056392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1137/2291] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:21 2022] PUT /identity/v3/projects/45c94ddec3ad4ab5b70c6cdeca713c35/users/d9096ab3645a4eb1b39dcbba3a7511c1/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:22.059654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:22.060246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:22.060536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:22.096378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] MFA Rules not processed for user `d9096ab3645a4eb1b39dcbba3a7511c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:22.098216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:22.173984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1155/2292] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:22.185199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:22.186898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:22.243008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909ffd-52e5-44fe-b483-d3ccef8c6e2f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:22.246910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:22.247610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:22.247882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:22.248251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:22.257412 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:22.258772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:22.268397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1138/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:22.379228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:22.391743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994888a-3f53-452b-9d2f-ce35d945d679 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:22.395966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ced5a-dd15-4528-af04-5d4a2ce1d294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:22.396745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ced5a-dd15-4528-af04-5d4a2ce1d294 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:22.397047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ced5a-dd15-4528-af04-5d4a2ce1d294 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:22.397299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ced5a-dd15-4528-af04-5d4a2ce1d294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:22.490079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ced5a-dd15-4528-af04-5d4a2ce1d294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:22.491689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ced5a-dd15-4528-af04-5d4a2ce1d294 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:22.502229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1156/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:25.220030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:25.310989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9df96-e502-4fd1-867c-83ad20620afc service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:25.315983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:25.316951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:25.317238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:25.317509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] PATH_INFO: `/v3/users/dc105f33cb2149cfb65770942fea7d39` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:25.318656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc105f33cb2149cfb65770942fea7d39)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:25.320615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:25.367725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc105f33cb2149cfb65770942fea7d39'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:25.374324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc105f33cb2149cfb65770942fea7d39'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:25.374966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc105f33cb2149cfb65770942fea7d39'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:25.382034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc105f33cb2149cfb65770942fea7d39'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:25.382706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc105f33cb2149cfb65770942fea7d39'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:25.391142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:25.403533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1139/2295] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:25 2022] DELETE /identity/v3/users/dc105f33cb2149cfb65770942fea7d39 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:25.408142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:25.408604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:25.408698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:25.427817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:25.429054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:25.493815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1157/2296] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:25.503605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:25.505091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:25.564133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb21b6-9740-41c1-974a-4d13bbf9d12e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:25.567867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b920-e45a-4b24-860b-31f53f3416a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:25.568507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b920-e45a-4b24-860b-31f53f3416a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:25.568787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b920-e45a-4b24-860b-31f53f3416a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:25.569060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b920-e45a-4b24-860b-31f53f3416a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:25.578932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b920-e45a-4b24-860b-31f53f3416a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:25.580403 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b920-e45a-4b24-860b-31f53f3416a3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:25.591840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1140/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:25.905824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:25.907541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:25.924197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ac860-0bb9-45b0-800e-51ee89e881b2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:25.936657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:25.937381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:25.937771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:25.938185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] PATH_INFO: `/v3/projects/91fb2cea17c046958de7f57ec83bc108` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:25.940319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fb2cea17c046958de7f57ec83bc108)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:25.943743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:25.978397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:25.979350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:25.979557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:25.979879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:26.002776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] MFA Rules not processed for user `d9535f39625b4c1893dc4533dc93a3df`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:26.004043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:26.009608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fb2cea17c046958de7f57ec83bc108', 'request_id': 'req-5c2694cc-86e4-4ce9-ab96-50579e491219'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.020557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fb2cea17c046958de7f57ec83bc108', 'request_id': 'req-5c2694cc-86e4-4ce9-ab96-50579e491219'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.029099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fb2cea17c046958de7f57ec83bc108', 'request_id': 'req-5c2694cc-86e4-4ce9-ab96-50579e491219'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.042181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] The token cache is being invalidate because project 91fb2cea17c046958de7f57ec83bc108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:26.042377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.043030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.046309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1158/2298] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:25 2022] DELETE /identity/v3/projects/91fb2cea17c046958de7f57ec83bc108 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:26.048814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:26.050392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:26.070748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1141/2299] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:26.124789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2694cc-86e4-4ce9-ab96-50579e491219 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:26.129842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:26.130491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:26.130781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:26.131547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] PATH_INFO: `/v3/users/d9096ab3645a4eb1b39dcbba3a7511c1` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:26.136997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9096ab3645a4eb1b39dcbba3a7511c1)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:26.139697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:26.191580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9096ab3645a4eb1b39dcbba3a7511c1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.192364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9096ab3645a4eb1b39dcbba3a7511c1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.199546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9096ab3645a4eb1b39dcbba3a7511c1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.200270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9096ab3645a4eb1b39dcbba3a7511c1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.207633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-410e8477-37c0-4800-bd70-c27129230f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9096ab3645a4eb1b39dcbba3a7511c1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.232718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1159/2300] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:26 2022] DELETE /identity/v3/users/d9096ab3645a4eb1b39dcbba3a7511c1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:26.772937 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:26.786474 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b13d19-2c2c-4a85-b49e-71dbec62df1f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:26.872261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:26.873090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:26.873375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:26.873710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] PATH_INFO: `/v3/projects/45c94ddec3ad4ab5b70c6cdeca713c35` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:26.875295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c94ddec3ad4ab5b70c6cdeca713c35)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:26.877513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:26.943405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:26.954433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c94ddec3ad4ab5b70c6cdeca713c35', 'request_id': 'req-44503ca1-0e77-4d62-9af7-2775c72ebe35'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.962568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c94ddec3ad4ab5b70c6cdeca713c35', 'request_id': 'req-44503ca1-0e77-4d62-9af7-2775c72ebe35'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.972089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c94ddec3ad4ab5b70c6cdeca713c35', 'request_id': 'req-44503ca1-0e77-4d62-9af7-2775c72ebe35'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.989144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] The token cache is being invalidate because project 45c94ddec3ad4ab5b70c6cdeca713c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:26.989456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.990501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-44503ca1-0e77-4d62-9af7-2775c72ebe35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:26.992561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1142/2301] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:26 2022] DELETE /identity/v3/projects/45c94ddec3ad4ab5b70c6cdeca713c35 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:26.998189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.001048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.001650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.055851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:27.057340 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:27.083422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:27.151133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1160/2302] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:27.157202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.157509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.157838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.191092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:27.192661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:27.201982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1143/2303] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:27.208205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:27.244402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ee108-f4ba-484f-a33f-7612e51ec6b6 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:27.250023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:27.250854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.250978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.251234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.251899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:27.252401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:27.254084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:27.274230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:27.276225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1161/2304] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:27.286425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b8568-0cef-42ef-9842-3e61aad187e2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:27.291888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:27.292245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.292538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.292795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.293485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:27.295588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:27.334694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1144/2305] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:27 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:27.335512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:27.351920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f2d37-0a52-47ce-8e75-b096a36c64a2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:27.431564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:27.433369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.433756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.434705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.435560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:27.438023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:27.475379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1162/2306] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:27 2022] POST /identity/v3/users => generated 304 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:27.479195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:27.498580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e530-96d5-4482-bd1b-d51b2ed5ac5d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:27.511771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:27.513126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.513406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.513673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.514351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:27.520219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:27.532907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1145/2307] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:27.536961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:27.565908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66989b0-ae65-48a2-91eb-70cf04f82292 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:27.582175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454bc1b-2872-471b-ab0b-cf71b2bd5652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:27.582816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454bc1b-2872-471b-ab0b-cf71b2bd5652 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.583106 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454bc1b-2872-471b-ab0b-cf71b2bd5652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.583382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454bc1b-2872-471b-ab0b-cf71b2bd5652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.584110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454bc1b-2872-471b-ab0b-cf71b2bd5652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:27.585857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454bc1b-2872-471b-ab0b-cf71b2bd5652 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:27.618258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1163/2308] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:27.623058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:27.642752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652ec7a-20b1-475e-aeab-7745e771dedf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:27.662247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:27.663473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.664125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.664522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] PATH_INFO: `/v3/projects/1b6dc8e400644cbc9c09b0976d04e65c/users/67556b4c7d0745c7baa437aad3399547/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.689177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6dc8e400644cbc9c09b0976d04e65c, user_id=67556b4c7d0745c7baa437aad3399547, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:27.692886 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:27.722479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1146/2309] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:27 2022] PUT /identity/v3/projects/1b6dc8e400644cbc9c09b0976d04e65c/users/67556b4c7d0745c7baa437aad3399547/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:27.724971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222aee4-328f-4865-a848-b1fc22a0254f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:27.725478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222aee4-328f-4865-a848-b1fc22a0254f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:27.725795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222aee4-328f-4865-a848-b1fc22a0254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:27.764615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e222aee4-328f-4865-a848-b1fc22a0254f None None] MFA Rules not processed for user `67556b4c7d0745c7baa437aad3399547`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:27.765900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e222aee4-328f-4865-a848-b1fc22a0254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:27.898716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1164/2310] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:27 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:27.903662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.086532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.087099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.087099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.114760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daab93-7031-48ad-8452-0df8413d6b44 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.121898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.122663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.123031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.123368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.124743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.126735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:28.134039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] MFA Rules not processed for user `5ac2c0f2fcb349c68604724730d274df`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:28.137732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:28.167979 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:28.179380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1147/2311] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:27 2022] POST /identity/v3/projects => generated 407 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:28.180710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.258183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1165/2312] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:28.292517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:28.313921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8383c53-d299-44ba-a5cd-f440c784fe42 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.319927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.320691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.321040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.321379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.322095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.325099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:28.388096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.392018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1148/2313] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:28 2022] POST /identity/v3/users => generated 310 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:28.407040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967085be-f7fd-4ab7-98cb-098fd7aae081 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.412248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.413047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.414029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.414470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.415298 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.417829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:28.430003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1166/2314] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:28.434182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.445354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb97b1-2988-4803-8d58-3eed1d7d9217 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.462727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.463678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.464047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.464414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] PATH_INFO: `/v3/projects/4327f20888bb4ad88321ebe7ba862421/users/c9ad40e2e50b4b4e82761b76e56f476a/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.483041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4327f20888bb4ad88321ebe7ba862421, user_id=c9ad40e2e50b4b4e82761b76e56f476a, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.489304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:28.513695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1149/2315] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:28 2022] PUT /identity/v3/projects/4327f20888bb4ad88321ebe7ba862421/users/c9ad40e2e50b4b4e82761b76e56f476a/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:28.517639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.531920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d9651-fea5-47db-9e8f-a72cbf7aab1d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.630080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc53ab-ab7c-4a19-8bae-70e6d1e57a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.630705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc53ab-ab7c-4a19-8bae-70e6d1e57a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.630996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc53ab-ab7c-4a19-8bae-70e6d1e57a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.631271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc53ab-ab7c-4a19-8bae-70e6d1e57a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.631950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc53ab-ab7c-4a19-8bae-70e6d1e57a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.633606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc53ab-ab7c-4a19-8bae-70e6d1e57a35 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:28.649814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1167/2316] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:28.657551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.683968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ac112-5e94-40c7-83c6-155fdd12b1c4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.689201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.690029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.690317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.691923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] PATH_INFO: `/v3/projects/4327f20888bb4ad88321ebe7ba862421/users/c9ad40e2e50b4b4e82761b76e56f476a/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.694123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4327f20888bb4ad88321ebe7ba862421, user_id=c9ad40e2e50b4b4e82761b76e56f476a, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.697701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:28.712789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1150/2317] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:28 2022] PUT /identity/v3/projects/4327f20888bb4ad88321ebe7ba862421/users/c9ad40e2e50b4b4e82761b76e56f476a/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:28.723554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.723842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.724146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.760541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] MFA Rules not processed for user `c9ad40e2e50b4b4e82761b76e56f476a`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:28.761862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:28.860266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1168/2318] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:28.872804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:28.876981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:28.963306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0cde-4552-422b-9fb9-c1bb1457b76f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:28.975592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:28.976560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:28.976841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:28.977110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:28.991902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:28.994294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:29.007651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1151/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:28 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:29.273422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:29.297707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9aac-089f-4c99-b5e8-3ed6a31f020f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:29.305429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58730-18b2-456d-a299-491f01b6e393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:29.306239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58730-18b2-456d-a299-491f01b6e393 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:29.306683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58730-18b2-456d-a299-491f01b6e393 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:29.307105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58730-18b2-456d-a299-491f01b6e393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:29.370285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=100 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:29.403625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f58730-18b2-456d-a299-491f01b6e393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:29.405118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f58730-18b2-456d-a299-491f01b6e393 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:29.416687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1169/2320] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:32.226487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:32.228183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:32.318593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fed11-f728-45c0-b562-fe237624f81f service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:32.324882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:32.325820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:32.326179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:32.326641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] PATH_INFO: `/v3/users/632d276721ae48e29ff8285dc99ce6c1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:32.328115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=632d276721ae48e29ff8285dc99ce6c1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:32.330694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:32.430769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632d276721ae48e29ff8285dc99ce6c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:32.430769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:32.446219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632d276721ae48e29ff8285dc99ce6c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:32.447867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632d276721ae48e29ff8285dc99ce6c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:32.459643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632d276721ae48e29ff8285dc99ce6c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:32.461634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632d276721ae48e29ff8285dc99ce6c1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:32.497693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1152/2321] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:32 2022] DELETE /identity/v3/users/632d276721ae48e29ff8285dc99ce6c1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:32.499265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:32.499771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:32.499911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:32.707594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:32.709069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:32.878753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1170/2322] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:32.893296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:32.895118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:32.998701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe99f5-0ee9-440c-aeeb-2e1b5e58bbd5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.006270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db0944-697d-40f4-a1b0-759deb05fd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.009411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0944-697d-40f4-a1b0-759deb05fd36 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.010434 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0944-697d-40f4-a1b0-759deb05fd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.010911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0944-697d-40f4-a1b0-759deb05fd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.023656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db0944-697d-40f4-a1b0-759deb05fd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.026366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db0944-697d-40f4-a1b0-759deb05fd36 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.040502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1153/2323] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:33.355963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.357452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:33.370952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9a41-c9e3-4f88-814a-2b38d7430bfa None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.376858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.377705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.378082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.378636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] PATH_INFO: `/v3/projects/6590276b307d49eabc3626b48a453e69` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.379977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6590276b307d49eabc3626b48a453e69)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.383850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.439827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6590276b307d49eabc3626b48a453e69', 'request_id': 'req-2a0d35d9-8082-427e-acf5-8386c07c16f7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:33.454949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6590276b307d49eabc3626b48a453e69', 'request_id': 'req-2a0d35d9-8082-427e-acf5-8386c07c16f7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:33.462498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6590276b307d49eabc3626b48a453e69', 'request_id': 'req-2a0d35d9-8082-427e-acf5-8386c07c16f7'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:33.474259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] The token cache is being invalidate because project 6590276b307d49eabc3626b48a453e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:33.474406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:33.475094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2a0d35d9-8082-427e-acf5-8386c07c16f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:33.476917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1171/2324] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:33 2022] DELETE /identity/v3/projects/6590276b307d49eabc3626b48a453e69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:33.483243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.483786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.483786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.504174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:33.505359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:33.570490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1154/2325] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:33.579035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.579508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.579609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.601016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:33.602359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:33.610934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1172/2326] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:33.615602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.626584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ceff-ef28-4679-9932-1d52e718e0bf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.631318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.631872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.632188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.632461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.633107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:33.633408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.635317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.647556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1155/2327] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:19:33.652073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.661155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df410ab8-9580-4c88-95a5-4e723fe37f2f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.665924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.666542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.666818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.667086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.667715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.670159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.702148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1173/2328] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:33 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:33.706534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.717305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4e7d8-cadc-4031-9093-37dbabb11942 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.781039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:33.801096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.801878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.802156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.802425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.803063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.805063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.846900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1156/2329] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:33 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:33.851237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.862468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3392a-761b-47b9-94ad-a6a7adbec79e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.869785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.870416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.870692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.870962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.872218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.873818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.892933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1174/2330] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:33.893456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.909900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd48d-3123-4f0d-8a76-73d47e3cd83e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.917052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b06569-d3a3-40bd-8972-5fae36769d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.917729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b06569-d3a3-40bd-8972-5fae36769d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.918534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b06569-d3a3-40bd-8972-5fae36769d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.918805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b06569-d3a3-40bd-8972-5fae36769d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:33.919824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b06569-d3a3-40bd-8972-5fae36769d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:33.922768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b06569-d3a3-40bd-8972-5fae36769d74 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:33.938110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1157/2331] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:33.942669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:33.976985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6b03-58fb-4c51-9c2e-411c073190a9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:33.985218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:33.986600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:33.986950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:33.987289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] PATH_INFO: `/v3/projects/551958783d6944979f3bd9447e2810c2/users/ea0fa0bcfb2a4a5d8024478bc2bb9baf/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:34.023314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551958783d6944979f3bd9447e2810c2, user_id=ea0fa0bcfb2a4a5d8024478bc2bb9baf, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:34.027080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:34.032259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:34.048435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1175/2332] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:33 2022] PUT /identity/v3/projects/551958783d6944979f3bd9447e2810c2/users/ea0fa0bcfb2a4a5d8024478bc2bb9baf/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:34.058422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:34.058737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:34.059017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:34.118981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] MFA Rules not processed for user `ea0fa0bcfb2a4a5d8024478bc2bb9baf`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:34.120511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:34.222653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1158/2333] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:34.241666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:34.245210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:34.323509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937df9-e40a-4716-8a2b-dcf907dd5d18 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:34.327242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc995a-2ddc-4d49-9c62-25482aef0051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:34.328194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc995a-2ddc-4d49-9c62-25482aef0051 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:34.328473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc995a-2ddc-4d49-9c62-25482aef0051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:34.328744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc995a-2ddc-4d49-9c62-25482aef0051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:34.338307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc995a-2ddc-4d49-9c62-25482aef0051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:34.340802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc995a-2ddc-4d49-9c62-25482aef0051 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:34.349263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1176/2334] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:35.519342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:35.520822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:35.588468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132502e-d285-4aa8-8e26-dcf05b2c0c10 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:35.593605 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:35.594246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:35.594524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:35.594797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] PATH_INFO: `/v3/users/67556b4c7d0745c7baa437aad3399547` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:35.596005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67556b4c7d0745c7baa437aad3399547)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:35.598130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:35.654734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67556b4c7d0745c7baa437aad3399547'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:35.665391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67556b4c7d0745c7baa437aad3399547'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:35.668860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67556b4c7d0745c7baa437aad3399547'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:35.674687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67556b4c7d0745c7baa437aad3399547'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:35.675459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67556b4c7d0745c7baa437aad3399547'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:35.677785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:35.696437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1159/2335] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:35 2022] DELETE /identity/v3/users/67556b4c7d0745c7baa437aad3399547 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:35.701486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:35.702030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:35.702030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:35.721957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:35.723168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:35.787044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1177/2336] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:35.798532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:35.800172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:35.868973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278b212-902b-4a89-ad54-5f192d2535c0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:35.873116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:35.873757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:35.874034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:35.874323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:35.883961 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:35.885758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:35.896378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1160/2337] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:36.184851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:36.186474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:36.198693 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8b2bc-b8c2-4b53-993c-63d3a0508389 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:36.204538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:36.205453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:36.205906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:36.206251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] PATH_INFO: `/v3/projects/1b6dc8e400644cbc9c09b0976d04e65c` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:36.208052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6dc8e400644cbc9c09b0976d04e65c)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:36.210430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:36.270529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6dc8e400644cbc9c09b0976d04e65c', 'request_id': 'req-1a37e556-bb88-4854-860b-90350eef445b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.286144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6dc8e400644cbc9c09b0976d04e65c', 'request_id': 'req-1a37e556-bb88-4854-860b-90350eef445b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.295430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6dc8e400644cbc9c09b0976d04e65c', 'request_id': 'req-1a37e556-bb88-4854-860b-90350eef445b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.313961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] The token cache is being invalidate because project 1b6dc8e400644cbc9c09b0976d04e65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:36.314399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.315178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.319633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1178/2338] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:36 2022] DELETE /identity/v3/projects/1b6dc8e400644cbc9c09b0976d04e65c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:36.321491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:36.332359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c20fb-05c9-405f-8586-eb2d98b5be32 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:36.401900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:36.402602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:36.402875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:36.403149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] PATH_INFO: `/v3/users/c9ad40e2e50b4b4e82761b76e56f476a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:36.404335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ad40e2e50b4b4e82761b76e56f476a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:36.406400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:36.466796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ad40e2e50b4b4e82761b76e56f476a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.475085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ad40e2e50b4b4e82761b76e56f476a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.475766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ad40e2e50b4b4e82761b76e56f476a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.483928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ad40e2e50b4b4e82761b76e56f476a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.484943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ad40e2e50b4b4e82761b76e56f476a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:36.505163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1161/2339] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:36 2022] DELETE /identity/v3/users/c9ad40e2e50b4b4e82761b76e56f476a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:36.886398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:36.888580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:36.902608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e556-bb88-4854-860b-90350eef445b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:36.932458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:36.946905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:36.948485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:36.960084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:36.986430 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:36.987250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:36.987625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:36.988023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] PATH_INFO: `/v3/projects/4327f20888bb4ad88321ebe7ba862421` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:36.989383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4327f20888bb4ad88321ebe7ba862421)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:36.992128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.035967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c891cae-cef9-4c45-aa6b-88547b8ce118 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.046900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4327f20888bb4ad88321ebe7ba862421', 'request_id': 'req-a20dc5b8-55be-413f-a795-e8b902fdaa9e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.056094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4327f20888bb4ad88321ebe7ba862421', 'request_id': 'req-a20dc5b8-55be-413f-a795-e8b902fdaa9e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.064474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4327f20888bb4ad88321ebe7ba862421', 'request_id': 'req-a20dc5b8-55be-413f-a795-e8b902fdaa9e'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.090604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] The token cache is being invalidate because project 4327f20888bb4ad88321ebe7ba862421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:37.090906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.091698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a20dc5b8-55be-413f-a795-e8b902fdaa9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.093585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1179/2340] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:36 2022] DELETE /identity/v3/projects/4327f20888bb4ad88321ebe7ba862421 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:37.099920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6e19-fb66-40a4-82cf-d76f3ddb9785 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.100579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6e19-fb66-40a4-82cf-d76f3ddb9785 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.101013 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6e19-fb66-40a4-82cf-d76f3ddb9785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.122430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.123073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.123348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.123638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] PATH_INFO: `/v3/users/ea0fa0bcfb2a4a5d8024478bc2bb9baf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.124936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0fa0bcfb2a4a5d8024478bc2bb9baf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.126946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.128357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-39ab6e19-fb66-40a4-82cf-d76f3ddb9785 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:37.129598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-39ab6e19-fb66-40a4-82cf-d76f3ddb9785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:37.138905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1180/2341] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:37.186799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0fa0bcfb2a4a5d8024478bc2bb9baf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.197878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0fa0bcfb2a4a5d8024478bc2bb9baf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.198810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0fa0bcfb2a4a5d8024478bc2bb9baf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.207189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0fa0bcfb2a4a5d8024478bc2bb9baf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.207910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ba5008e7-6f8c-45a5-a0fd-84a87830f74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0fa0bcfb2a4a5d8024478bc2bb9baf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:37.209009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.209238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.209524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.227165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1162/2342] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:36 2022] DELETE /identity/v3/users/ea0fa0bcfb2a4a5d8024478bc2bb9baf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:37.232002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.232287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.232400 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:37.232558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.233503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:37.252449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:37.253668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:37.283266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:37.310998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1181/2343] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:37.311984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.321023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cbb4-f04e-4969-9fde-938e8923ca71 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.325679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.326268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.326542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.326808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.327442 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:37.327739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.329422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.340687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1163/2344] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:37.342416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1182/2345] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:37.346556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.350802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.352491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:37.356867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f7058-e0bb-428b-bab6-85e7792ce268 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.362302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.362946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.363224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.363504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.364202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.366143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.392864 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:37.396995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1164/2346] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:37.401351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.420934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ee8a-1908-4db7-b5bd-191b49e82884 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.483800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.484510 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.484785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.485466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.489083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcab8e4-3e09-4f7f-b841-afefd461bfb9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.498363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.498595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.499194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.499544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.499884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.500541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.500677 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.503029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.517351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1183/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:37.536295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1165/2348] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:37.540183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.552827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9835e5a-6008-4fe2-afc1-9198086dfa12 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.561903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.562152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.562324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.562627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.563364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.565088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.576666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1184/2349] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:37.581098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.592984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254241c-244b-44fc-adf3-0fafa367ee51 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.601101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687626f-e3e6-495b-a183-143184c461d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.601866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687626f-e3e6-495b-a183-143184c461d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.602198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687626f-e3e6-495b-a183-143184c461d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.602485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687626f-e3e6-495b-a183-143184c461d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.604142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687626f-e3e6-495b-a183-143184c461d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.609100 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687626f-e3e6-495b-a183-143184c461d2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.623197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1166/2350] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:37.627389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.641991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bff3-cead-463f-99e7-98ab9999f76e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.649012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.649740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.650027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.650306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] PATH_INFO: `/v3/projects/5adfb7aeff944250b73d0f42f141c560/users/af2390eab3bc46a5a8a2235a4849c810/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.671081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adfb7aeff944250b73d0f42f141c560, user_id=af2390eab3bc46a5a8a2235a4849c810, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.674089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:37.700139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1185/2351] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:37 2022] PUT /identity/v3/projects/5adfb7aeff944250b73d0f42f141c560/users/af2390eab3bc46a5a8a2235a4849c810/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:37.710630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.710921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.711219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.745108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] MFA Rules not processed for user `af2390eab3bc46a5a8a2235a4849c810`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:37.747133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:37.883297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1167/2352] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:37.889191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:37.981205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a5fb-4af9-4bd0-bf35-54306a795890 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:37.986233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:37.986905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:37.987189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:37.987463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:37.988184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:37.990099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.017935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.020304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.038234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6d8ca-5cc9-4fb2-8fbc-303c7830c346 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.038679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1186/2353] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:37 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:38.039657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.059340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:38.092819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:38.116211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e07b-3549-4b5f-8f1f-124d6f200ecb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.122388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.123175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.123651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.123760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.124457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.127490 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.132706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.134041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.134519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.135209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] PATH_INFO: `/v3/projects/551958783d6944979f3bd9447e2810c2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.136987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=551958783d6944979f3bd9447e2810c2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.140111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.156193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1187/2354] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:38.160358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.173670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb0bd9-1c53-4aff-ae15-029502dd2b90 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.179831 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.180727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.181050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.181572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.182329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.184421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.198993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1188/2355] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:38.200707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.210971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c558a2-0e7a-4b7f-9132-9b95bc680113 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.217712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551958783d6944979f3bd9447e2810c2', 'request_id': 'req-1cce3477-f489-488f-8659-0b34b0defd2b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:38.225297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551958783d6944979f3bd9447e2810c2', 'request_id': 'req-1cce3477-f489-488f-8659-0b34b0defd2b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:38.236394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551958783d6944979f3bd9447e2810c2', 'request_id': 'req-1cce3477-f489-488f-8659-0b34b0defd2b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:38.254840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] The token cache is being invalidate because project 551958783d6944979f3bd9447e2810c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:38.256096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:38.256847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1cce3477-f489-488f-8659-0b34b0defd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:38.258640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1168/2356] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:38 2022] DELETE /identity/v3/projects/551958783d6944979f3bd9447e2810c2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:38.264219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bada26-38f9-4375-885a-8ebbc5d8714b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.264511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bada26-38f9-4375-885a-8ebbc5d8714b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.264804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bada26-38f9-4375-885a-8ebbc5d8714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.284003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.284615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.284902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.285175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.285817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.287405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.288867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4bada26-38f9-4375-885a-8ebbc5d8714b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:38.290864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4bada26-38f9-4375-885a-8ebbc5d8714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.301449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1189/2357] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:38.301614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1169/2358] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:38.302462 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.304192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.307741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.308176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.308576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.319276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d325684-ee64-4030-8dce-c1b958b345aa admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.325886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ea089-971f-4b6e-9b16-8c7c83fe90c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.326664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea089-971f-4b6e-9b16-8c7c83fe90c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.327125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea089-971f-4b6e-9b16-8c7c83fe90c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.327444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea089-971f-4b6e-9b16-8c7c83fe90c6 admin admin] PATH_INFO: `/v3/projects/1ded258a913340bca5a1e5859f0a67cd/users/554faaf19a5f4ce0824390ef5c3178b9/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.334454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:38.335912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.344849 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1170/2359] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:38.346606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ea089-971f-4b6e-9b16-8c7c83fe90c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ded258a913340bca5a1e5859f0a67cd, user_id=554faaf19a5f4ce0824390ef5c3178b9, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.348823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.349498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ea089-971f-4b6e-9b16-8c7c83fe90c6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.359516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25313dcb-69e4-42a2-96d8-13e6f4b4b134 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.366873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1190/2360] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:38 2022] PUT /identity/v3/projects/1ded258a913340bca5a1e5859f0a67cd/users/554faaf19a5f4ce0824390ef5c3178b9/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:38.379619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.379916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.380215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.409465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] MFA Rules not processed for user `554faaf19a5f4ce0824390ef5c3178b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:38.410749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.432611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.433232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.433574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.434348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.435002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:38.435308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.437099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.449399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1171/2361] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:38.453558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.465228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653602a1-29ab-4356-a923-835a4566a3c4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.471205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.471726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.472050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.472330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.473006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.474960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.489735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1191/2362] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:38.494256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.505363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1172/2363] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:38.506973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5ef09-1978-4080-975d-259c23145a1f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.509070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.519123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:38.526082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:38.566021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.566658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.566946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.567230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.567862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.569850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.579190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3a29-d07b-4ae6-accf-9258162111f0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.583795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.584435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.584709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.584976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.585773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.588563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.600769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1192/2364] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:38.604735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.619427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1173/2365] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:38.620528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.632243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d0ba-8072-497d-9e7b-828e3e762886 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.671124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffabfd-ef6e-49c8-890f-54f9abaacc47 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.675745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.676373 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.676678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.676947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.677570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.679468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.689793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.690544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.690825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.691091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.692010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.694044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.700694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1193/2366] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:38.704413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1174/2367] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:38.704558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.708321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.714179 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f36491-87d1-4688-89e6-3dad362d0ba1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.718635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef811-677f-4e1c-ac56-22fcf9454073 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.719449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.720070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.720344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.720603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.721367 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.722923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.723422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.724117 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.724399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.724670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.725335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.726899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.734173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1194/2368] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:38.738263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.740953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1175/2369] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:38.744997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.748577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e21a5-bd85-4a73-aca8-94c4076c626e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.753522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.754175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.754459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.754735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] PATH_INFO: `/v3/projects/8067adf1bf67449eb7d6390102ac1021/users/d64b2eee85d94c87a130a7892ad986bc/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.756752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af1167-cc19-4cab-9197-a5df57ba91a3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.763243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c996a4-685b-41ec-bd65-d2cd16bf0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.764351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c996a4-685b-41ec-bd65-d2cd16bf0798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.764638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c996a4-685b-41ec-bd65-d2cd16bf0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.764913 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c996a4-685b-41ec-bd65-d2cd16bf0798 admin admin] PATH_INFO: `/v3/projects/c7ec3e573f64489ea7fd87eabf405b90/users/218d0ae10b824b56ba78793ea1e868e1/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.770034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8067adf1bf67449eb7d6390102ac1021, user_id=d64b2eee85d94c87a130a7892ad986bc, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.772716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.780639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c996a4-685b-41ec-bd65-d2cd16bf0798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ec3e573f64489ea7fd87eabf405b90, user_id=218d0ae10b824b56ba78793ea1e868e1, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.783287 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c996a4-685b-41ec-bd65-d2cd16bf0798 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.786647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1195/2370] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:38 2022] PUT /identity/v3/projects/8067adf1bf67449eb7d6390102ac1021/users/d64b2eee85d94c87a130a7892ad986bc/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:38.790422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.799181 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1176/2371] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:38 2022] PUT /identity/v3/projects/c7ec3e573f64489ea7fd87eabf405b90/users/218d0ae10b824b56ba78793ea1e868e1/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:38.810007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.810283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.810668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.839729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] MFA Rules not processed for user `218d0ae10b824b56ba78793ea1e868e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:38.841890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.863477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee38c2-31ae-420a-93b1-3148090ddcdb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:38.869820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:38.908256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:38.936119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1177/2372] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:38.956222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:38.960377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:38.960926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:38.961712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:38.962279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:38.962747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:38.963604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:38.965992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:38.983974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1196/2373] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:38.988922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:39.000706 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d24579-ee78-4f6c-9f27-9ec2dd532ad6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:39.006776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb2c25-a48d-47e0-be0e-f270eddbbe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:39.007551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb2c25-a48d-47e0-be0e-f270eddbbe9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.008144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb2c25-a48d-47e0-be0e-f270eddbbe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.008646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb2c25-a48d-47e0-be0e-f270eddbbe9c admin admin] PATH_INFO: `/v3/projects/8067adf1bf67449eb7d6390102ac1021/users/d64b2eee85d94c87a130a7892ad986bc/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.012378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb2c25-a48d-47e0-be0e-f270eddbbe9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8067adf1bf67449eb7d6390102ac1021, user_id=d64b2eee85d94c87a130a7892ad986bc, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:39.016605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb2c25-a48d-47e0-be0e-f270eddbbe9c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:39.032107 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1197/2374] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:38 2022] PUT /identity/v3/projects/8067adf1bf67449eb7d6390102ac1021/users/d64b2eee85d94c87a130a7892ad986bc/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:39.041856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.042133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.042404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.049780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01674a6-6d6e-4db9-9d0a-25e3b8cd9802 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:39.093688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] MFA Rules not processed for user `d64b2eee85d94c87a130a7892ad986bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:39.095126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:39.150498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:39.151205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.151683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.152637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.218990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1198/2375] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:39.233132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:39.234109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:39.234755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:39.235680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:39.247371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1178/2376] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:39.262885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120e498-2078-47ca-bf1a-ed5b8c97f6b8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:39.266880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:39.267500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.267785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.268094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.269917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:39.273308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:39.343023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:39.344230 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:39.344773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1975331-f3b5-4e0a-9393-52816f017b54 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:39.349814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4b641-21cf-4b1d-afa5-5fe69e7864ed service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:39.353515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1199/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:39.354957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:39.356244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.356590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.356931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] PATH_INFO: `/v3/users/218d0ae10b824b56ba78793ea1e868e1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.358298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218d0ae10b824b56ba78793ea1e868e1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:39.360618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:39.429615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218d0ae10b824b56ba78793ea1e868e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:39.441911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218d0ae10b824b56ba78793ea1e868e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:39.442837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218d0ae10b824b56ba78793ea1e868e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:39.453150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218d0ae10b824b56ba78793ea1e868e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:39.454343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218d0ae10b824b56ba78793ea1e868e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:39.479472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1179/2378] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:39 2022] DELETE /identity/v3/users/218d0ae10b824b56ba78793ea1e868e1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:39.483484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.483777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.484090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.508051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:39.508772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:39.520128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:39.587558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1200/2379] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:39.598483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:39.601847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:39.701464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030b344-3d1e-46c1-85d6-3c8d8e6a3728 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:39.709777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11da7a-7045-4d8f-807d-8643ab81bd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:39.709884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11da7a-7045-4d8f-807d-8643ab81bd8c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:39.710125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11da7a-7045-4d8f-807d-8643ab81bd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:39.710404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11da7a-7045-4d8f-807d-8643ab81bd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:39.732358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11da7a-7045-4d8f-807d-8643ab81bd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:39.732358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11da7a-7045-4d8f-807d-8643ab81bd8c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:39.734053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1180/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:40.034711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.037757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:40.052455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbdb8d-8414-4fc0-a565-fc6113df1460 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.058287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.059547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.059966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.060459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] PATH_INFO: `/v3/projects/c7ec3e573f64489ea7fd87eabf405b90` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.061548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ec3e573f64489ea7fd87eabf405b90)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.063768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.112937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ec3e573f64489ea7fd87eabf405b90', 'request_id': 'req-6f514eb0-dad8-426b-924b-6b7cb43e31d9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:40.119921 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ec3e573f64489ea7fd87eabf405b90', 'request_id': 'req-6f514eb0-dad8-426b-924b-6b7cb43e31d9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:40.126200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ec3e573f64489ea7fd87eabf405b90', 'request_id': 'req-6f514eb0-dad8-426b-924b-6b7cb43e31d9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:40.136810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] The token cache is being invalidate because project c7ec3e573f64489ea7fd87eabf405b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:40.137092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:40.138205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6f514eb0-dad8-426b-924b-6b7cb43e31d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:40.139168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1201/2381] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:40 2022] DELETE /identity/v3/projects/c7ec3e573f64489ea7fd87eabf405b90 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:40.143956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.144409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.144506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.170178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:40.171414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:40.238374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1181/2382] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:40.245787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.246108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.246390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.267871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:40.269995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:40.279815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1202/2383] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:40.284293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.294894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff0332-0913-42ab-9bc4-7ad06880bb53 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.299969 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.300590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.300864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.301132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.301779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:40.302078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.303663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.318715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1182/2384] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:40.328930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.341876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaf84f-db93-4ba9-bbeb-a07f4948c639 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.347758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.348413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.348682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.348949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.349594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.352212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.384478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1203/2385] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:40 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:40.390843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.403201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554af5-544a-4f67-93b1-3445eb39a761 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.408025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:40.481855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.488544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.489148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.489726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.490767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.494226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.520920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1183/2386] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:40 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:19:40.532898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.543339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5baf8-20fe-4dc4-8177-4b03e59eb099 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.548160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.548785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.549059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.549334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.549973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.551535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.561512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1204/2387] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:40.565375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.575711 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaa281-8f41-476b-8e15-bb4009f57b51 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.580363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76afda-9cb1-4cb2-adcc-b219f17dd04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.580952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76afda-9cb1-4cb2-adcc-b219f17dd04e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.581226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76afda-9cb1-4cb2-adcc-b219f17dd04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.581496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76afda-9cb1-4cb2-adcc-b219f17dd04e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.582129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76afda-9cb1-4cb2-adcc-b219f17dd04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.583709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76afda-9cb1-4cb2-adcc-b219f17dd04e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.594679 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1184/2388] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:40.600014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.611140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557be6c5-bfdb-4e8e-867d-84f18c2c9ea8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.615793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.616557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.617226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.617530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] PATH_INFO: `/v3/projects/3229abcd2a394905805ffacd931f546d/users/9c9f6b6ece36458aa1fc93a9219c537e/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.631780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3229abcd2a394905805ffacd931f546d, user_id=9c9f6b6ece36458aa1fc93a9219c537e, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.634519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.647994 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1205/2389] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:40 2022] PUT /identity/v3/projects/3229abcd2a394905805ffacd931f546d/users/9c9f6b6ece36458aa1fc93a9219c537e/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:40.653812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.654040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.654343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.672572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:40.673763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:40.731763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1185/2390] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:40.741366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.743031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:40.785388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:40.813618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a1b19-c984-488d-a38e-068617ba0aab admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:40.818094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c49c1-35ec-4dc1-b0fa-29265c366bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:40.819271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c49c1-35ec-4dc1-b0fa-29265c366bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:40.819656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c49c1-35ec-4dc1-b0fa-29265c366bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:40.820219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c49c1-35ec-4dc1-b0fa-29265c366bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:40.842677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c49c1-35ec-4dc1-b0fa-29265c366bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:40.844344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c49c1-35ec-4dc1-b0fa-29265c366bf7 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:40.863562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1206/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:40.966090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:40.967627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:41.030097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd007-c671-43e6-94fc-3397ab76e8c3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:41.034246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:41.035099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:41.035510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:41.035783 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:41.038246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:41.083642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:41.104160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:41.106406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:41.116383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1186/2392] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:41.572212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:41.572739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:41.572955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:41.653744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] MFA Rules not processed for user `9c9f6b6ece36458aa1fc93a9219c537e`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:41.658489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:41.788024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1207/2393] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:41.793305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:41.815224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0de72-2b0d-4a69-9c3d-fe5081b4cfb1 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:41.819280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb857e7d-5603-45bd-91f8-2fc463e5779c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:41.820070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857e7d-5603-45bd-91f8-2fc463e5779c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:41.820373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857e7d-5603-45bd-91f8-2fc463e5779c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:41.820816 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb857e7d-5603-45bd-91f8-2fc463e5779c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:41.838376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb857e7d-5603-45bd-91f8-2fc463e5779c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:41.840440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb857e7d-5603-45bd-91f8-2fc463e5779c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:41.862468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1187/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:41.981001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:41.983187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:42.005424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18cd46-242d-42c1-8040-71de21ab5df9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:42.009540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:42.011887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:42.012303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:42.012961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:42.015768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:42.159630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:42.161180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:42.179785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1208/2395] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:43.443906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedba924-ccb9-41fd-aa1f-3e3f5d286e4d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:43.444765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedba924-ccb9-41fd-aa1f-3e3f5d286e4d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:43.445316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedba924-ccb9-41fd-aa1f-3e3f5d286e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:43.479912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bedba924-ccb9-41fd-aa1f-3e3f5d286e4d None None] MFA Rules not processed for user `9c9f6b6ece36458aa1fc93a9219c537e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:43.481735 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bedba924-ccb9-41fd-aa1f-3e3f5d286e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:43.496277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1188/2396] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:46.217249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:46.218628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:46.232346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3837d-ee2e-4906-8851-f89e9c995c99 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:46.236952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:46.237569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:46.237850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:46.238118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] PATH_INFO: `/v3/users/af2390eab3bc46a5a8a2235a4849c810` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:46.239215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2390eab3bc46a5a8a2235a4849c810)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:46.241131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:46.288486 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2390eab3bc46a5a8a2235a4849c810'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:46.289143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2390eab3bc46a5a8a2235a4849c810'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:46.296852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2390eab3bc46a5a8a2235a4849c810'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:46.297536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2390eab3bc46a5a8a2235a4849c810'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:46.299407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:46.306153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2390eab3bc46a5a8a2235a4849c810'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:46.324629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1209/2397] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:46 2022] DELETE /identity/v3/users/af2390eab3bc46a5a8a2235a4849c810 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:46.328878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:46.329384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:46.329490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:46.348818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:46.350106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:46.413633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1189/2398] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:46.423452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:46.424891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:46.485769 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd02b-c766-4318-a538-0e373e5da8d7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:46.489396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:46.489995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:46.490266 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:46.490532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:46.499744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:46.501171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:46.511117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1210/2399] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:47.154918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:47.156393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:47.169112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02219-4db7-4cc7-a868-f73c50cd2522 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:47.175031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:47.175675 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:47.175975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:47.176267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] PATH_INFO: `/v3/projects/5adfb7aeff944250b73d0f42f141c560` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:47.177484 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adfb7aeff944250b73d0f42f141c560)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:47.184972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:47.246581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adfb7aeff944250b73d0f42f141c560', 'request_id': 'req-ca31584e-64bd-4901-bb0c-76965cc22b6f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.253751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adfb7aeff944250b73d0f42f141c560', 'request_id': 'req-ca31584e-64bd-4901-bb0c-76965cc22b6f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.263294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adfb7aeff944250b73d0f42f141c560', 'request_id': 'req-ca31584e-64bd-4901-bb0c-76965cc22b6f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.278320 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] The token cache is being invalidate because project 5adfb7aeff944250b73d0f42f141c560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:47.278612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.279424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.281074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1190/2400] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:47 2022] DELETE /identity/v3/projects/5adfb7aeff944250b73d0f42f141c560 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:47.285596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:47.295963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844e7b-be59-4580-8f1f-cb6b2b56a0c5 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:47.355341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:47.356002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:47.356284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:47.356559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] PATH_INFO: `/v3/users/554faaf19a5f4ce0824390ef5c3178b9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:47.357674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554faaf19a5f4ce0824390ef5c3178b9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:47.359597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:47.406989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554faaf19a5f4ce0824390ef5c3178b9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.407634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554faaf19a5f4ce0824390ef5c3178b9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.416186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554faaf19a5f4ce0824390ef5c3178b9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.416886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554faaf19a5f4ce0824390ef5c3178b9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.429551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554faaf19a5f4ce0824390ef5c3178b9'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:47.443366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:47.456653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1211/2401] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:47 2022] DELETE /identity/v3/users/554faaf19a5f4ce0824390ef5c3178b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:47.890482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:47.891952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:47.905838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31584e-64bd-4901-bb0c-76965cc22b6f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:47.949144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:47.966988 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:47.967760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:47.968172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:47.968609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] PATH_INFO: `/v3/users/7435657ffd3a42fc9a52c551e418e7a1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:47.970189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7435657ffd3a42fc9a52c551e418e7a1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:47.972140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:47.982746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:47.984431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:47.998956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d940136-d1f9-4d56-89dd-9098b1ada004 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:48.005004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:48.006220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:48.006617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:48.007127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] PATH_INFO: `/v3/projects/1ded258a913340bca5a1e5859f0a67cd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:48.008957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ded258a913340bca5a1e5859f0a67cd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:48.012718 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:48.029533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7435657ffd3a42fc9a52c551e418e7a1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.040522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7435657ffd3a42fc9a52c551e418e7a1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.042750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7435657ffd3a42fc9a52c551e418e7a1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.053705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7435657ffd3a42fc9a52c551e418e7a1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.054419 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4e99ae8e-3111-4a70-898c-cdae057341bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7435657ffd3a42fc9a52c551e418e7a1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.071186 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ded258a913340bca5a1e5859f0a67cd', 'request_id': 'req-ee5b82e7-b3a5-47d3-aa59-336965d09f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.076910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1191/2402] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:47 2022] DELETE /identity/v3/users/7435657ffd3a42fc9a52c551e418e7a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:48.081423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:48.081869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:48.082059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:48.084809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ded258a913340bca5a1e5859f0a67cd', 'request_id': 'req-ee5b82e7-b3a5-47d3-aa59-336965d09f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.092815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ded258a913340bca5a1e5859f0a67cd', 'request_id': 'req-ee5b82e7-b3a5-47d3-aa59-336965d09f26'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.102597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:48.103895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:48.105574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] The token cache is being invalidate because project 1ded258a913340bca5a1e5859f0a67cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:48.105574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.106263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.110918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1212/2403] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:47 2022] DELETE /identity/v3/projects/1ded258a913340bca5a1e5859f0a67cd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:48.112151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:48.113736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:48.179973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1192/2404] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:48.190774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:48.192196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:48.207124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b82e7-b3a5-47d3-aa59-336965d09f26 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:48.214933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:48.215666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:48.215967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:48.216259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] PATH_INFO: `/v3/users/d64b2eee85d94c87a130a7892ad986bc` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:48.217499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64b2eee85d94c87a130a7892ad986bc)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:48.219777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:48.301392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd7076-8ce3-409b-bcad-6d579799017d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:48.305700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:48.306371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:48.306646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:48.306912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:48.320798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:48.322564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:48.322798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64b2eee85d94c87a130a7892ad986bc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.323686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64b2eee85d94c87a130a7892ad986bc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.341792 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1193/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:19:48.343379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64b2eee85d94c87a130a7892ad986bc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.344697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64b2eee85d94c87a130a7892ad986bc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.355621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64b2eee85d94c87a130a7892ad986bc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:48.382439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:48.390316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1213/2406] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:19:48 2022] DELETE /identity/v3/users/d64b2eee85d94c87a130a7892ad986bc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:49.247591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:49.264650 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28846c3-0ff2-41f8-bbe9-81055f53c87c service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:49.271955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:49.368438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:49.369695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:49.369695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:49.369881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] PATH_INFO: `/v3/projects/8067adf1bf67449eb7d6390102ac1021` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:49.372091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8067adf1bf67449eb7d6390102ac1021)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:49.374229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:49.445850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8067adf1bf67449eb7d6390102ac1021', 'request_id': 'req-6fe28acc-74ba-4714-a0e9-53085a659b99'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:49.454182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8067adf1bf67449eb7d6390102ac1021', 'request_id': 'req-6fe28acc-74ba-4714-a0e9-53085a659b99'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:49.463329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8067adf1bf67449eb7d6390102ac1021', 'request_id': 'req-6fe28acc-74ba-4714-a0e9-53085a659b99'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:49.477457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] The token cache is being invalidate because project 8067adf1bf67449eb7d6390102ac1021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:49.477970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:49.478791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6fe28acc-74ba-4714-a0e9-53085a659b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:49.481204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1194/2407] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:49 2022] DELETE /identity/v3/projects/8067adf1bf67449eb7d6390102ac1021 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:49.764611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:49.767323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:49.791287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a231bfb-8e01-4d65-89b2-d517003799bd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:49.969842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:49.970476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:49.970756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:49.971028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] PATH_INFO: `/v3/projects/72dc0217054b4588867ad1431b3a7441` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:49.972166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72dc0217054b4588867ad1431b3a7441)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:49.974065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.032640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72dc0217054b4588867ad1431b3a7441', 'request_id': 'req-90814e37-20cf-42bc-82fb-2021ded26bb8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:50.046720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72dc0217054b4588867ad1431b3a7441', 'request_id': 'req-90814e37-20cf-42bc-82fb-2021ded26bb8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:50.066315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72dc0217054b4588867ad1431b3a7441', 'request_id': 'req-90814e37-20cf-42bc-82fb-2021ded26bb8'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:50.088191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] The token cache is being invalidate because project 72dc0217054b4588867ad1431b3a7441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:19:50.089419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:50.090563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-90814e37-20cf-42bc-82fb-2021ded26bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:19:50.108595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1214/2408] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:19:49 2022] DELETE /identity/v3/projects/72dc0217054b4588867ad1431b3a7441 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:19:50.110664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.111146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.111437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.145142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:50.146380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:50.300253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1195/2409] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:50.307064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.307351 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.307650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.332448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:50.333620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:50.344312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1215/2410] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:50.348166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.358774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb42687-d977-4669-9644-cbfc43000690 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.364242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.365027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.365310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.365586 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.366238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:19:50.366550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:50.368174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.381155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1196/2411] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:19:50.386542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.397005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275cc3d-f5cf-493d-a2e3-f0fe3d263fc4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.403413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.404147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.404487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.404837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.405560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:50.407509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.439402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1216/2412] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:19:50 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:50.440603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.451828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd432d-1f88-49ba-a175-28d3de119bc0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.485924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:50.565893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.566534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.566813 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.567085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.568480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:50.569979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.622944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1197/2413] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:19:50 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:19:50.627014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.644064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7593d-ede7-4e9a-9b51-4d370a87743e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.649750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.650653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.650937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.651208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.651896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:50.653518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.674692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1217/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:19:50.679125 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.691671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28fe5d-fc13-4c13-a3ae-e8d850e47ea6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.704668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81385-c205-4919-b651-d5759ce04021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.705455 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81385-c205-4919-b651-d5759ce04021 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.705817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81385-c205-4919-b651-d5759ce04021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.706147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81385-c205-4919-b651-d5759ce04021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.706927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81385-c205-4919-b651-d5759ce04021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:50.708948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a81385-c205-4919-b651-d5759ce04021 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.725601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1198/2415] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:19:50.730022 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.741535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788ea27-7d4a-48fa-8036-89ea934b8edb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.749751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.749751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.749751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.749751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] PATH_INFO: `/v3/projects/197ba7cac9cb4edcb5ef053118b0bd34/users/44744cc9bbb64e68a34883c2a3e56366/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.764656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] RBAC: Authorizing `identity:create_grant(project_id=197ba7cac9cb4edcb5ef053118b0bd34, user_id=44744cc9bbb64e68a34883c2a3e56366, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:50.767376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:50.783515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1218/2416] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:19:50 2022] PUT /identity/v3/projects/197ba7cac9cb4edcb5ef053118b0bd34/users/44744cc9bbb64e68a34883c2a3e56366/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:19:50.794494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025f55-61b4-4bed-82a4-73e28b8b0390 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.794775 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025f55-61b4-4bed-82a4-73e28b8b0390 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.795047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025f55-61b4-4bed-82a4-73e28b8b0390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:50.824008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f9025f55-61b4-4bed-82a4-73e28b8b0390 None None] MFA Rules not processed for user `44744cc9bbb64e68a34883c2a3e56366`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:50.827627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f9025f55-61b4-4bed-82a4-73e28b8b0390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:50.898557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1199/2417] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:50.910491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:50.912274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:50.945969 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:50.990269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862c924-e917-4ded-b511-c66e184c9add admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:50.994537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2172f2-0759-49c2-919c-46cff5e129ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:50.995477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2172f2-0759-49c2-919c-46cff5e129ee service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:50.996970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2172f2-0759-49c2-919c-46cff5e129ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:50.997312 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2172f2-0759-49c2-919c-46cff5e129ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:51.009047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2172f2-0759-49c2-919c-46cff5e129ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:51.011863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2172f2-0759-49c2-919c-46cff5e129ee service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:51.025624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1219/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:19:52.224614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:52.225129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:52.225215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:52.246219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] MFA Rules not processed for user `51129e120cd14371b995bcc451264981`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:52.247594 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:52.332928 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1200/2419] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:19:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:19:53.254881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:53.255354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:53.255456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:53.275883 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:19:53.277674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:53.335280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1220/2420] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:19:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:19:53.380725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:19:53.382317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:19:53.439095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:53.482353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca41b8-49b9-463f-b501-3066ab5d219e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:19:53.489275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be460fa-8ac6-49de-acf7-a4e3163ec6d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:19:53.490054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be460fa-8ac6-49de-acf7-a4e3163ec6d1 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:19:53.490334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be460fa-8ac6-49de-acf7-a4e3163ec6d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:19:53.490631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be460fa-8ac6-49de-acf7-a4e3163ec6d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:19:53.501034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be460fa-8ac6-49de-acf7-a4e3163ec6d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:19:53.503515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be460fa-8ac6-49de-acf7-a4e3163ec6d1 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:19:53.516213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1201/2421] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:19:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:20:02.085419 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:02.161857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234264b4-f23c-4eac-b4b3-5218f8017bca None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:02.168086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:02.168801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:02.169141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:02.169666 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] PATH_INFO: `/v3/users/44744cc9bbb64e68a34883c2a3e56366` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:02.171348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=44744cc9bbb64e68a34883c2a3e56366)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:02.174226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:02.236588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44744cc9bbb64e68a34883c2a3e56366'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:02.237248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44744cc9bbb64e68a34883c2a3e56366'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:02.247570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44744cc9bbb64e68a34883c2a3e56366'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:02.249301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44744cc9bbb64e68a34883c2a3e56366'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:02.260499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44744cc9bbb64e68a34883c2a3e56366'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:02.269292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:02.283689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1221/2422] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:20:02 2022] DELETE /identity/v3/users/44744cc9bbb64e68a34883c2a3e56366 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:20:02.285261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:02.285964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:02.285964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:02.322914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:02.324662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:02.399162 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1202/2423] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:02.407183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:02.408753 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:02.485976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad668d-d1da-4d7b-ac9f-cfe18e7e03ca admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:02.496680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda626c-efc7-4614-975f-0099ad3c9d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:02.497306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda626c-efc7-4614-975f-0099ad3c9d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:02.497583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda626c-efc7-4614-975f-0099ad3c9d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:02.497851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda626c-efc7-4614-975f-0099ad3c9d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:02.507985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda626c-efc7-4614-975f-0099ad3c9d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:02.510048 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda626c-efc7-4614-975f-0099ad3c9d28 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:02.522463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1222/2424] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:02.908087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:02.909808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:02.934808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197596b1-b6e6-4bb7-8e13-d291492256bf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:02.950931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:02.952303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:02.952660 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:02.952938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] PATH_INFO: `/v3/projects/197ba7cac9cb4edcb5ef053118b0bd34` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:02.954799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197ba7cac9cb4edcb5ef053118b0bd34)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:02.957199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:03.022219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197ba7cac9cb4edcb5ef053118b0bd34', 'request_id': 'req-3478055b-c735-4503-b017-025f91c2f4c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:03.029903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197ba7cac9cb4edcb5ef053118b0bd34', 'request_id': 'req-3478055b-c735-4503-b017-025f91c2f4c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:03.038769 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197ba7cac9cb4edcb5ef053118b0bd34', 'request_id': 'req-3478055b-c735-4503-b017-025f91c2f4c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:03.050782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] The token cache is being invalidate because project 197ba7cac9cb4edcb5ef053118b0bd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:20:03.051146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:03.051900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:03.053704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1203/2425] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:20:02 2022] DELETE /identity/v3/projects/197ba7cac9cb4edcb5ef053118b0bd34 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:20:12.518208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=29,keystone:DELETE=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:13.047004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:16.614695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:16.615188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:16.615344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:16.635238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:16.636498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:16.692041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1223/2426] 10.222.0.27 () {58 vars in 967 bytes} [Sat Oct 1 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:16.705324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:16.706727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:16.777756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478055b-c735-4503-b017-025f91c2f4c7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:16.782696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:16.783302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:16.783579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:16.783854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:16.794637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:16.796261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:16.804464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1204/2427] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:20:18.729437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:18.730949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:18.797191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3443e-61df-4abe-9af3-86ffb5e08ffb None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:18.801678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:18.802301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:18.802576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:18.802847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] PATH_INFO: `/v3/users/d9535f39625b4c1893dc4533dc93a3df` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:18.804231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9535f39625b4c1893dc4533dc93a3df)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:18.806145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:18.853034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9535f39625b4c1893dc4533dc93a3df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:18.854262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9535f39625b4c1893dc4533dc93a3df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:18.861460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9535f39625b4c1893dc4533dc93a3df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:18.862114 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9535f39625b4c1893dc4533dc93a3df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:18.870664 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-327517cf-1c3e-4bac-af7c-e5a8949da4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9535f39625b4c1893dc4533dc93a3df'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:18.890404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1224/2428] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:20:18 2022] DELETE /identity/v3/users/d9535f39625b4c1893dc4533dc93a3df => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:20:19.063850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.075306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c07e2-3fdb-49e1-97de-364173b02403 service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.133460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.134347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.134621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.134890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] PATH_INFO: `/v3/projects/7670d93928e741f396ba611fb841bc86` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.136071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7670d93928e741f396ba611fb841bc86)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.137993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.186050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7670d93928e741f396ba611fb841bc86', 'request_id': 'req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:19.192892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7670d93928e741f396ba611fb841bc86', 'request_id': 'req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:19.201273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7670d93928e741f396ba611fb841bc86', 'request_id': 'req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:19.213381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] The token cache is being invalidate because project 7670d93928e741f396ba611fb841bc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:20:19.213670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:19.214285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-efc0fe6d-bee5-4bcb-81e0-9cf60e8abbf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:19.215814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1205/2429] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:20:19 2022] DELETE /identity/v3/projects/7670d93928e741f396ba611fb841bc86 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:20:19.220789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.221105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.221382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.241144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:19.241823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:19.261130 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:19.305345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1225/2430] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:19.314379 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.314663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.314935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.334706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:19.335890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:19.343673 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1206/2431] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:19.347788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.357205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1a41-3a68-4787-bd7c-fdff432eb492 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.361749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.362339 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.362615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.362881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.363525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:20:19.363824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.365423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.377200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1226/2432] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:20:19.381598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.392057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bcb71-8663-4b1a-b067-56b3ce2421c5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.396684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.397282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.397559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.397832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.398480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.400437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.411624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:19.429615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1207/2433] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:20:19 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:20:19.434370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.444165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b741f64-a248-427e-86f8-042c4704356c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.502414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.503023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.503305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.503580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.504240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.506145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.527278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1227/2434] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:20:19 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:20:19.531359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.541591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4376-de31-4bf5-9927-e597e5181acc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.546185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.546780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.547061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.547334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.547998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.549590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.559285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1208/2435] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:20:19.563093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.574099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84d203-00cd-4778-b3d2-dd5766256e89 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.578694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88100a-3b08-4afb-b59b-d1e4f8fe9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.579277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88100a-3b08-4afb-b59b-d1e4f8fe9d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.579557 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88100a-3b08-4afb-b59b-d1e4f8fe9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.579829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88100a-3b08-4afb-b59b-d1e4f8fe9d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.580509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88100a-3b08-4afb-b59b-d1e4f8fe9d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.582108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88100a-3b08-4afb-b59b-d1e4f8fe9d22 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.593031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1228/2436] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:20:19.597006 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.607712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e705b8d-5f4f-4754-b205-7637da1bfac2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.612382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.613027 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.613327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.613599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] PATH_INFO: `/v3/projects/63fab8df726e45f1b54e9d2deda117c9/users/a64fb49bb2964bfbbca72ec351a04978/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.629787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fab8df726e45f1b54e9d2deda117c9, user_id=a64fb49bb2964bfbbca72ec351a04978, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.632492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.646168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1209/2437] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:20:19 2022] PUT /identity/v3/projects/63fab8df726e45f1b54e9d2deda117c9/users/a64fb49bb2964bfbbca72ec351a04978/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:20:19.657140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942226a-1bc2-4494-a19f-96c6bca4546b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.657433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942226a-1bc2-4494-a19f-96c6bca4546b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.658083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942226a-1bc2-4494-a19f-96c6bca4546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.690044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6942226a-1bc2-4494-a19f-96c6bca4546b None None] MFA Rules not processed for user `a64fb49bb2964bfbbca72ec351a04978`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:19.691167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6942226a-1bc2-4494-a19f-96c6bca4546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:19.754722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1229/2438] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:20:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:19.766642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:19.768376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:19.824780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924c316-ee62-49d6-9d24-0f0d0208b358 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:19.828582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:19.829188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:19.829461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:19.829726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:19.838015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:19.839426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:19.847947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1210/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:25.153038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0033d8-cb56-4a89-bd53-b506f26baff7 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:25.153530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0033d8-cb56-4a89-bd53-b506f26baff7 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:25.153627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0033d8-cb56-4a89-bd53-b506f26baff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:25.173448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5a0033d8-cb56-4a89-bd53-b506f26baff7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:25.174638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5a0033d8-cb56-4a89-bd53-b506f26baff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:25.187997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:25.241926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1230/2440] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:25.264529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:25.267825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:25.346897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f16c48-5771-4bdc-9cd4-c9df35c4584b service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:25.352458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:25.353696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:25.353986 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:25.354256 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:25.362682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:25.364551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:25.374304 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1211/2441] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:28.169125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:28.169708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:28.169708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:28.189873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:28.191086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:28.199806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1231/2442] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:28.218932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:28.220384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:28.235765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1f287-3c4a-43b8-b1fd-876fd5e006ef service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:28.241448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c8afd-b0f1-4684-a32c-cecaf7fe9ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:28.242053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c8afd-b0f1-4684-a32c-cecaf7fe9ac1 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:28.242331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c8afd-b0f1-4684-a32c-cecaf7fe9ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:28.242604 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c8afd-b0f1-4684-a32c-cecaf7fe9ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:28.250935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c8afd-b0f1-4684-a32c-cecaf7fe9ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:28.252568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c8afd-b0f1-4684-a32c-cecaf7fe9ac1 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:28.264489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1212/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:30.030200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:30.039968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bd393-2660-4235-af3b-b15813ca474e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:30.044884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:30.045499 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:30.045772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:30.046043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] PATH_INFO: `/v3/users/a64fb49bb2964bfbbca72ec351a04978` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:30.047136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64fb49bb2964bfbbca72ec351a04978)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:30.049074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:30.095344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64fb49bb2964bfbbca72ec351a04978'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.096066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64fb49bb2964bfbbca72ec351a04978'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.109409 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64fb49bb2964bfbbca72ec351a04978'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.110135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64fb49bb2964bfbbca72ec351a04978'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.117590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64fb49bb2964bfbbca72ec351a04978'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.137015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1232/2444] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:20:30 2022] DELETE /identity/v3/users/a64fb49bb2964bfbbca72ec351a04978 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:20:30.141466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:30.141948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:30.142044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:30.160504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:30.161676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:30.187718 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:30.221294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1213/2445] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:30.231793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:30.233291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:30.291342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800220e-a197-43f1-b547-b27173f5cc81 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:30.295016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341af62-6f00-4127-9f2b-52787ffc46f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:30.295620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341af62-6f00-4127-9f2b-52787ffc46f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:30.295898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341af62-6f00-4127-9f2b-52787ffc46f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:30.296208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341af62-6f00-4127-9f2b-52787ffc46f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:30.305054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341af62-6f00-4127-9f2b-52787ffc46f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:30.306478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341af62-6f00-4127-9f2b-52787ffc46f7 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:30.315832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1233/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:30.647926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:30.649464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:30.661678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ca1c-92ae-4b05-bdb4-e44d1cf02834 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:30.667733 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:30.668555 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:30.668938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:30.669396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] PATH_INFO: `/v3/projects/63fab8df726e45f1b54e9d2deda117c9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:30.670746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fab8df726e45f1b54e9d2deda117c9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:30.672852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:30.722087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fab8df726e45f1b54e9d2deda117c9', 'request_id': 'req-dfb6bad5-a796-4e57-952b-534e841b8aa1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.728619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fab8df726e45f1b54e9d2deda117c9', 'request_id': 'req-dfb6bad5-a796-4e57-952b-534e841b8aa1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.736152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fab8df726e45f1b54e9d2deda117c9', 'request_id': 'req-dfb6bad5-a796-4e57-952b-534e841b8aa1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.747589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] The token cache is being invalidate because project 63fab8df726e45f1b54e9d2deda117c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:20:30.747898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.748600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:20:30.750110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1214/2447] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:20:30 2022] DELETE /identity/v3/projects/63fab8df726e45f1b54e9d2deda117c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:20:31.397470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875d04a-40c8-4684-ac04-69bfa09ce483 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:31.397970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875d04a-40c8-4684-ac04-69bfa09ce483 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:31.397970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875d04a-40c8-4684-ac04-69bfa09ce483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:31.418282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5875d04a-40c8-4684-ac04-69bfa09ce483 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:31.419476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5875d04a-40c8-4684-ac04-69bfa09ce483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:31.443452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:31.478403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1234/2448] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:31.492819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:31.494947 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:31.566313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6bad5-a796-4e57-952b-534e841b8aa1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:31.571786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:31.572414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:31.572688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:31.572955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:31.581093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:31.582879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:31.592362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1215/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:34.506302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac372-5366-46f3-9e3f-9a2f8ae63057 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:34.506836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac372-5366-46f3-9e3f-9a2f8ae63057 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:34.506945 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac372-5366-46f3-9e3f-9a2f8ae63057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:34.527103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cbbac372-5366-46f3-9e3f-9a2f8ae63057 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:34.528330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cbbac372-5366-46f3-9e3f-9a2f8ae63057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:34.536077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1235/2450] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:34.554643 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:34.566543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4c39f-aab1-4aea-93a0-7e8971cbf843 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:34.572207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:34.572804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:34.573084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:34.573353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:34.581506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:34.583078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:34.592284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1216/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:37.640127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf6f9-59a3-4628-b844-fffd4aafa9a5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:37.640638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf6f9-59a3-4628-b844-fffd4aafa9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:37.640827 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbf6f9-59a3-4628-b844-fffd4aafa9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:37.660727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9bbbf6f9-59a3-4628-b844-fffd4aafa9a5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:37.661929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9bbbf6f9-59a3-4628-b844-fffd4aafa9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:37.670228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1236/2452] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:37.687303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:37.698930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea31d9-f55e-4eb6-b4c1-f65c12d38e8a service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:37.705302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:37.706084 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:37.706368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:37.706635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:37.715964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:37.717542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:37.727923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1217/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:40.792277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f28d-11c3-4f0a-adac-004fc93c0101 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:40.792734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f28d-11c3-4f0a-adac-004fc93c0101 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:40.792841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f28d-11c3-4f0a-adac-004fc93c0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:40.812805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4908f28d-11c3-4f0a-adac-004fc93c0101 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:40.814019 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4908f28d-11c3-4f0a-adac-004fc93c0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:40.822364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1237/2454] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:40.837203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:40.839145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:40.854554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29d85-529b-48ee-a442-89d0174604b5 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:40.860080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:40.860674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:40.860948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:40.861214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:40.870040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:40.871591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:40.876433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:40.882350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1218/2455] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:50.807738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=23 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:51.632140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:51.632425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:51.632695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:51.652599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:51.653822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:51.709128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1238/2456] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:20:51.721752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:51.723138 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:51.791690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797e62-bd3d-4153-b706-773c840d72c2 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:51.797188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346a9e6-07b9-416a-b5a1-a325665ce424 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:51.797791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a9e6-07b9-416a-b5a1-a325665ce424 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:51.798065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a9e6-07b9-416a-b5a1-a325665ce424 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:51.798337 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a9e6-07b9-416a-b5a1-a325665ce424 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:51.806888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346a9e6-07b9-416a-b5a1-a325665ce424 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:51.808563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346a9e6-07b9-416a-b5a1-a325665ce424 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:51.819120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1219/2457] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:20:52.904916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:20:52.906524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:53.063260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a033f8a-2b5c-4e15-9da6-532e433f2450 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:20:53.080397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:20:53.081036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:53.081315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:53.081588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:53.093527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:53.113801 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:20:53.116849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb045d7f-ebc0-4011-978c-11cf8feefa86 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:20:53.155593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1239/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:20:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:20:58.990670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d6e0-e107-4249-bf11-e140c41ce473 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:20:58.991661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d6e0-e107-4249-bf11-e140c41ce473 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:20:58.991956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d6e0-e107-4249-bf11-e140c41ce473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:20:59.014528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2750d6e0-e107-4249-bf11-e140c41ce473 None None] MFA Rules not processed for user `9c9f6b6ece36458aa1fc93a9219c537e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:20:59.015741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2750d6e0-e107-4249-bf11-e140c41ce473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:20:59.093079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1220/2459] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:03.143711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=57 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:06.301097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfbfea-7162-49ec-8b6e-46af364ca729 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:06.301709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfbfea-7162-49ec-8b6e-46af364ca729 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:06.301709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfbfea-7162-49ec-8b6e-46af364ca729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:06.320451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-56bfbfea-7162-49ec-8b6e-46af364ca729 None None] MFA Rules not processed for user `5ac2c0f2fcb349c68604724730d274df`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:06.321662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-56bfbfea-7162-49ec-8b6e-46af364ca729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:06.378479 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1240/2460] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:21:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:08.857744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df11e-d337-4a6d-a5e4-fb15064b318b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:08.858688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df11e-d337-4a6d-a5e4-fb15064b318b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:08.859152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df11e-d337-4a6d-a5e4-fb15064b318b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:08.860734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1221/2461] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:21:08.866675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0e79-5908-4b98-b0ef-20d0a1ab11fe None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:08.867140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0e79-5908-4b98-b0ef-20d0a1ab11fe None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:08.867255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0e79-5908-4b98-b0ef-20d0a1ab11fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:08.888455 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e9ff0e79-5908-4b98-b0ef-20d0a1ab11fe None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:08.889986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e9ff0e79-5908-4b98-b0ef-20d0a1ab11fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:08.900702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1241/2462] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:21:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:08.913270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df11e-d337-4a6d-a5e4-fb15064b318b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:08.915503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c63df11e-d337-4a6d-a5e4-fb15064b318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:08.984746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df11e-d337-4a6d-a5e4-fb15064b318b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:08.988438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf5b05-5419-45a8-9ed4-91c8612fd4f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:08.989053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5b05-5419-45a8-9ed4-91c8612fd4f5 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:08.989329 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5b05-5419-45a8-9ed4-91c8612fd4f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:08.989708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf5b05-5419-45a8-9ed4-91c8612fd4f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.002626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf5b05-5419-45a8-9ed4-91c8612fd4f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:09.002626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf5b05-5419-45a8-9ed4-91c8612fd4f5 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:09.013595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1222/2463] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:09.087383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547820-5a51-4b19-a46f-53edeaf9c5c0 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:09.087725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547820-5a51-4b19-a46f-53edeaf9c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:09.088027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31547820-5a51-4b19-a46f-53edeaf9c5c0 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.089757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1242/2464] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:21:09.095430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3529ae4-efb2-4cee-bb43-8b3aaa6be894 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:09.095842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3529ae4-efb2-4cee-bb43-8b3aaa6be894 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:09.096216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3529ae4-efb2-4cee-bb43-8b3aaa6be894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.117551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c3529ae4-efb2-4cee-bb43-8b3aaa6be894 None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:09.118881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c3529ae4-efb2-4cee-bb43-8b3aaa6be894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:09.160007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:09.188387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1223/2465] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:09.200683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547820-5a51-4b19-a46f-53edeaf9c5c0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:09.202425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-31547820-5a51-4b19-a46f-53edeaf9c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:09.216346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31547820-5a51-4b19-a46f-53edeaf9c5c0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:09.219914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a20c9-b4ab-432f-81ac-6eba5478ba4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:09.220547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a20c9-b4ab-432f-81ac-6eba5478ba4d service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:09.220823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a20c9-b4ab-432f-81ac-6eba5478ba4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:09.221205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a20c9-b4ab-432f-81ac-6eba5478ba4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.229162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a20c9-b4ab-432f-81ac-6eba5478ba4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:09.230648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a20c9-b4ab-432f-81ac-6eba5478ba4d service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:09.241105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1243/2466] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:09.388820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a8fd-088b-4cf5-8d69-62b9f72a8e87 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:09.389103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a8fd-088b-4cf5-8d69-62b9f72a8e87 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:09.389374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a8fd-088b-4cf5-8d69-62b9f72a8e87 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.391002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1224/2467] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:21:09.395802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953916d1-db60-4296-b03a-f12a6147c1ad None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:09.396122 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953916d1-db60-4296-b03a-f12a6147c1ad None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:09.396407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953916d1-db60-4296-b03a-f12a6147c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.415454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-953916d1-db60-4296-b03a-f12a6147c1ad None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:09.416695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-953916d1-db60-4296-b03a-f12a6147c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:09.426680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1244/2468] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:09.437426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59a8fd-088b-4cf5-8d69-62b9f72a8e87 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:09.448808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59a8fd-088b-4cf5-8d69-62b9f72a8e87 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:09.453642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:09.454245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:09.454514 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:09.454780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:09.464919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:09.466369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:09.477540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1225/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:14.179838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c61be-f3de-40a0-adb1-ffa8e79913a5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:14.180467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c61be-f3de-40a0-adb1-ffa8e79913a5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:14.180467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c61be-f3de-40a0-adb1-ffa8e79913a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:14.200840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-822c61be-f3de-40a0-adb1-ffa8e79913a5 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:14.202059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-822c61be-f3de-40a0-adb1-ffa8e79913a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:14.209855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1245/2470] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:21:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:14.223252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:14.234851 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5c59-a849-47c8-bfe0-8cd0c9135a27 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:14.241639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2522-c2c4-44f2-8daf-bf6eef487ef4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:14.242245 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2522-c2c4-44f2-8daf-bf6eef487ef4 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:14.242522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2522-c2c4-44f2-8daf-bf6eef487ef4 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:14.242782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2522-c2c4-44f2-8daf-bf6eef487ef4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:14.251407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2522-c2c4-44f2-8daf-bf6eef487ef4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:14.252874 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2522-c2c4-44f2-8daf-bf6eef487ef4 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:14.261159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1226/2471] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:21:24.195210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=40 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:24.257824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=18 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:28.136296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:28.136860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:28.136860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:28.156357 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] MFA Rules not processed for user `51129e120cd14371b995bcc451264981`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:28.157436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:28.221295 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1246/2472] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:21:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:29.249513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c3b07-a938-4755-901b-69bf1fe1ad3c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:29.250005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c3b07-a938-4755-901b-69bf1fe1ad3c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:29.250130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c3b07-a938-4755-901b-69bf1fe1ad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:29.270543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bf7c3b07-a938-4755-901b-69bf1fe1ad3c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:29.271810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf7c3b07-a938-4755-901b-69bf1fe1ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:29.280104 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1227/2473] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:29.293818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:29.306619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ef75-d728-4b40-86dc-df085b9524c1 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:29.313063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:29.313678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:29.313961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:29.314417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:29.323846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:29.325493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:29.335005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1247/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:31.249188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fc1d-6ddd-48ad-879e-12d96be269cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:31.250164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fc1d-6ddd-48ad-879e-12d96be269cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:31.250591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fc1d-6ddd-48ad-879e-12d96be269cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:31.272778 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c099fc1d-6ddd-48ad-879e-12d96be269cc None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:31.274278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c099fc1d-6ddd-48ad-879e-12d96be269cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:31.284021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1228/2475] 10.222.0.27 () {58 vars in 967 bytes} [Sat Oct 1 04:21:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:31.296532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:31.308428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a64bd8-59cf-434e-8502-1aa9b26fe136 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:31.313671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:31.314273 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:31.314551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:31.314939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:31.323410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:31.325522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:31.334249 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1248/2476] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:21:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:21:32.499989 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2968c37-11f9-438b-9450-de466d9d7783 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:32.500500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2968c37-11f9-438b-9450-de466d9d7783 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:32.500620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2968c37-11f9-438b-9450-de466d9d7783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:32.520515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d2968c37-11f9-438b-9450-de466d9d7783 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:32.521635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d2968c37-11f9-438b-9450-de466d9d7783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:32.529317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1229/2477] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:32.542716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:32.554286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034f3ea-1a21-4d3d-9aa6-705428df35c8 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:32.560219 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:32.560809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:32.561089 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:32.561359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:32.569232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:32.570785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:32.580789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1249/2478] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:36.619572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425590ef-48b0-4c94-8e62-501c42d132df None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:36.620089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425590ef-48b0-4c94-8e62-501c42d132df None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:36.620207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425590ef-48b0-4c94-8e62-501c42d132df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:36.640377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-425590ef-48b0-4c94-8e62-501c42d132df None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:36.641567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-425590ef-48b0-4c94-8e62-501c42d132df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:36.649367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1230/2479] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:36.663580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:36.675135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869a515-a668-4b86-995f-722d8583a0dc service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:36.680887 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:36.681477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:36.681768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:36.682033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:36.690750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:36.692324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:36.701355 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1250/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:39.811887 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bbf8a-bf0f-4cee-949d-1376d33b7bf1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:39.812453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bbf8a-bf0f-4cee-949d-1376d33b7bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:39.812552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bbf8a-bf0f-4cee-949d-1376d33b7bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:39.831918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f45bbf8a-bf0f-4cee-949d-1376d33b7bf1 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:39.833142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f45bbf8a-bf0f-4cee-949d-1376d33b7bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:39.841421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1231/2481] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:39.857396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:39.868602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd78f7-7e16-4e57-a62d-02b22b36c409 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:39.873997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:39.874617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:39.874927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:39.875201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:39.883413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:39.885091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:39.894637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1251/2482] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:21:42.962631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:42.963132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:42.963237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:42.983252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:21:42.984507 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:21:42.992398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1232/2483] 10.222.0.13 () {58 vars in 1016 bytes} [Sat Oct 1 04:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:21:43.009247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:21:43.021435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c33e7-5427-4d9d-9834-f0b632242ac1 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:21:43.027415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:21:43.028605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:21:43.028861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:21:43.029121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:21:43.037449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:21:43.039052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:21:43.048957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1252/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:21:52.977870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=18 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:53.044826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=61 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:11.934227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:11.936592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:11.949971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afc6bb-ec78-4593-98e8-6e03e6d4b376 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:11.954714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:11.955375 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:11.955651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:11.955919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] PATH_INFO: `/v3/users/9c9f6b6ece36458aa1fc93a9219c537e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:11.957062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9f6b6ece36458aa1fc93a9219c537e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:11.958966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:12.004615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9f6b6ece36458aa1fc93a9219c537e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.012178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9f6b6ece36458aa1fc93a9219c537e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.012773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9f6b6ece36458aa1fc93a9219c537e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.019834 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9f6b6ece36458aa1fc93a9219c537e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.020479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf206f9f-9977-4666-b7a5-09d048f5d4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9f6b6ece36458aa1fc93a9219c537e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.037766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1233/2485] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:11 2022] DELETE /identity/v3/users/9c9f6b6ece36458aa1fc93a9219c537e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:12.205460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:12.217926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7add1-888c-4f9b-86f5-884cd5271064 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:12.276421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:12.277050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:12.277326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:12.277623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] PATH_INFO: `/v3/projects/3229abcd2a394905805ffacd931f546d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:12.278727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3229abcd2a394905805ffacd931f546d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:12.281131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:12.325632 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3229abcd2a394905805ffacd931f546d', 'request_id': 'req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.332968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3229abcd2a394905805ffacd931f546d', 'request_id': 'req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.339260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3229abcd2a394905805ffacd931f546d', 'request_id': 'req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.349894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] The token cache is being invalidate because project 3229abcd2a394905805ffacd931f546d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:12.350182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.350809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d0bb99ec-2c82-47fd-aa23-fcaa088b7205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:12.352296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1253/2486] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:12 2022] DELETE /identity/v3/projects/3229abcd2a394905805ffacd931f546d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:21.096785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:21.097332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:21.097332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:21.116281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] MFA Rules not processed for user `6b206c654b8f402785a06c31dd36ca40`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:21.117482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:21.176076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1234/2487] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:22.346986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:29.352318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:29.352918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:29.352918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:29.372128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] MFA Rules not processed for user `5ac2c0f2fcb349c68604724730d274df`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:29.373336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:29.426323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1254/2488] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:31.166739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:39.419008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=25 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:42.715371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:42.717330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:42.789974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e22324-55d9-423d-befe-215a304fb7ba None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:42.795606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:42.796344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:42.796625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:42.796909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] PATH_INFO: `/v3/users/51129e120cd14371b995bcc451264981` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:42.798418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51129e120cd14371b995bcc451264981)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:42.800636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:42.852790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51129e120cd14371b995bcc451264981'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:42.861550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51129e120cd14371b995bcc451264981'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:42.862227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51129e120cd14371b995bcc451264981'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:42.869446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51129e120cd14371b995bcc451264981'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:42.870109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6b7cf612-b5e2-4d73-bb42-12beeffc7dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51129e120cd14371b995bcc451264981'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:42.889164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1235/2489] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:42 2022] DELETE /identity/v3/users/51129e120cd14371b995bcc451264981 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:43.061221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.073297 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45293d9b-fe89-4cbe-87fc-9879747a6bc4 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.129071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.129696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.129973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.130245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] PATH_INFO: `/v3/projects/315314212d2c4f8ab69560bb730e439d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.131600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] RBAC: Authorizing `identity:delete_project(project_id=315314212d2c4f8ab69560bb730e439d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.133554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.177658 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315314212d2c4f8ab69560bb730e439d', 'request_id': 'req-1638c045-13fc-4466-a59a-9e353c96384d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:43.184399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315314212d2c4f8ab69560bb730e439d', 'request_id': 'req-1638c045-13fc-4466-a59a-9e353c96384d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:43.190465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315314212d2c4f8ab69560bb730e439d', 'request_id': 'req-1638c045-13fc-4466-a59a-9e353c96384d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:43.201097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] The token cache is being invalidate because project 315314212d2c4f8ab69560bb730e439d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:43.201382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:43.202024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1638c045-13fc-4466-a59a-9e353c96384d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:43.203472 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1255/2490] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:43 2022] DELETE /identity/v3/projects/315314212d2c4f8ab69560bb730e439d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:43.213655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.213933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.214224 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.234788 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:43.236032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:43.296551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1236/2491] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:43.304476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.304759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.305057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.324672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:43.326427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:43.334175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1256/2492] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:43.338547 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.348749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a35df-6e62-45f4-816f-69eaf9d31b16 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.353447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.354218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.354496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.354760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.355491 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:22:43.355855 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.357755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.369994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1237/2493] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:22:43.374438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.383839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d04d0-6bfa-4613-a70f-fba18709bcbe None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.389055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.389635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.389908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.390175 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.390806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.392716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.420539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1257/2494] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:43 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:43.424990 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.434823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47154-f842-4fbe-8625-629122541b23 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.438368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:43.492880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.493483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.493801 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.494091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.494751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.496691 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.519177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1238/2495] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:43 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:43.523307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.533443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862b7-507f-4b1f-81f3-cc2e7f552abc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.538020 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.538611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.538888 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.539159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.539790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.541403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.550946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1258/2496] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:43.554700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.565174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299289a8-d34a-4fc3-8b07-91d2d44e20b7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.569686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63059-6b05-4e09-b269-77ed7e643960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.570267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63059-6b05-4e09-b269-77ed7e643960 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.570540 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63059-6b05-4e09-b269-77ed7e643960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.570805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63059-6b05-4e09-b269-77ed7e643960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.571432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d63059-6b05-4e09-b269-77ed7e643960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.573043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d63059-6b05-4e09-b269-77ed7e643960 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.583858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1239/2497] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:43.587782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.597427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db9e6b-73fc-464b-ac87-03d66a27f681 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.601929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.602592 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.602867 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.603139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] PATH_INFO: `/v3/projects/e1ce9acd1d304dd1a8b9b1818d16f95d/users/699d567c902e4d84bcaa78ad6f51504e/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.617908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ce9acd1d304dd1a8b9b1818d16f95d, user_id=699d567c902e4d84bcaa78ad6f51504e, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.621209 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.634053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1259/2498] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:43 2022] PUT /identity/v3/projects/e1ce9acd1d304dd1a8b9b1818d16f95d/users/699d567c902e4d84bcaa78ad6f51504e/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:43.639676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deccdb6-491e-4065-92b2-30d1f080e9a7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.640080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deccdb6-491e-4065-92b2-30d1f080e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.640346 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deccdb6-491e-4065-92b2-30d1f080e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.659509 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1deccdb6-491e-4065-92b2-30d1f080e9a7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:43.660726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1deccdb6-491e-4065-92b2-30d1f080e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:43.717271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1240/2499] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:43.726698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:43.728397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:43.758980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:43.788773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb2c4-42ed-4b42-bb31-d820352953c4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:43.792425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:43.793096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:43.793329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:43.793673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:43.803121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:43.804597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:43.814858 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1260/2500] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:22:44.518549 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.518904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.519243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:44.549702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] MFA Rules not processed for user `699d567c902e4d84bcaa78ad6f51504e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:44.551022 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:44.635747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1241/2501] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:44.640261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:44.651155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f72d1-f2be-4f23-a0c3-15fa3748004a service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:44.656833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:44.657614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.658346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.658346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:44.658806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:44.660779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:44.695609 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1261/2502] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:44 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:44.699511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:44.712312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747220-74bf-48c3-b259-49fd1a851874 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:44.725819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:44.775317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:44.776016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.776242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.776515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:44.777170 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:44.779205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:44.804389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1242/2503] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:44 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:22:44.805614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:44.816910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaa88b-3391-4d6f-9292-2cd01c0395da admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:44.821481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:44.822081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.822358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.822628 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:44.823265 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:44.826278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:44.837264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1262/2504] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:44.840869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:44.851405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c2047-5579-4fb2-b4dc-d87782697a1e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:44.856543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:44.857725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.858007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.858282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] PATH_INFO: `/v3/projects/b3a98db54d4943a08567c8545a8d4402/users/b6bd2cc117e942c2a7e160c8fc66d673/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:44.874453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a98db54d4943a08567c8545a8d4402, user_id=b6bd2cc117e942c2a7e160c8fc66d673, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:44.877172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:44.890553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1243/2505] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:44 2022] PUT /identity/v3/projects/b3a98db54d4943a08567c8545a8d4402/users/b6bd2cc117e942c2a7e160c8fc66d673/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:44.894548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:44.904445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74e38c-4c40-497a-9983-9d99d81b423d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:44.961763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba55ca-d3b4-4eaf-9203-00ab898ba5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:44.962369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba55ca-d3b4-4eaf-9203-00ab898ba5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.962645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba55ca-d3b4-4eaf-9203-00ab898ba5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.962913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba55ca-d3b4-4eaf-9203-00ab898ba5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:44.963549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba55ca-d3b4-4eaf-9203-00ab898ba5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:44.965633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba55ca-d3b4-4eaf-9203-00ab898ba5f5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:44.976375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1263/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:44.981060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:44.992263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b76953-6405-430f-895e-df0341cfd584 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:44.996918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:44.997672 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:44.998012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:44.998345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] PATH_INFO: `/v3/projects/b3a98db54d4943a08567c8545a8d4402/users/b6bd2cc117e942c2a7e160c8fc66d673/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:45.000332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a98db54d4943a08567c8545a8d4402, user_id=b6bd2cc117e942c2a7e160c8fc66d673, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:45.003031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:45.014653 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1244/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:44 2022] PUT /identity/v3/projects/b3a98db54d4943a08567c8545a8d4402/users/b6bd2cc117e942c2a7e160c8fc66d673/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:45.797851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:45.798404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:45.798494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:45.830899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] MFA Rules not processed for user `b6bd2cc117e942c2a7e160c8fc66d673`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:45.832210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:45.904995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1264/2508] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:47.134457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:47.197143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd71a8-6b45-457b-b671-b07a8c3eb0b8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:47.202411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:47.203037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:47.203315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:47.203587 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] PATH_INFO: `/v3/users/699d567c902e4d84bcaa78ad6f51504e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:47.204736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] RBAC: Authorizing `identity:delete_user(user_id=699d567c902e4d84bcaa78ad6f51504e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:47.206669 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:47.254085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699d567c902e4d84bcaa78ad6f51504e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.261579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699d567c902e4d84bcaa78ad6f51504e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.262196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699d567c902e4d84bcaa78ad6f51504e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.269638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699d567c902e4d84bcaa78ad6f51504e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.270270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699d567c902e4d84bcaa78ad6f51504e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.275335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:47.289002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1245/2509] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:47 2022] DELETE /identity/v3/users/699d567c902e4d84bcaa78ad6f51504e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:47.459117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:47.470889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbd8b4-7b8a-4fcc-b3d1-dfd1cc3cf7cd None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:47.485129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:47.530598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:47.531215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:47.531489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:47.531756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] PATH_INFO: `/v3/projects/e1ce9acd1d304dd1a8b9b1818d16f95d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:47.532884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ce9acd1d304dd1a8b9b1818d16f95d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:47.534764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:47.580391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ce9acd1d304dd1a8b9b1818d16f95d', 'request_id': 'req-99d1be8f-3d97-439c-9863-1c510b0eb588'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.587364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ce9acd1d304dd1a8b9b1818d16f95d', 'request_id': 'req-99d1be8f-3d97-439c-9863-1c510b0eb588'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.593488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ce9acd1d304dd1a8b9b1818d16f95d', 'request_id': 'req-99d1be8f-3d97-439c-9863-1c510b0eb588'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.603533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] The token cache is being invalidate because project e1ce9acd1d304dd1a8b9b1818d16f95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:47.603818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.604465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.605918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1265/2510] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:47 2022] DELETE /identity/v3/projects/e1ce9acd1d304dd1a8b9b1818d16f95d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:47.610499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:47.611883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:47.626371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daa1f4-71ed-46f8-90cd-e6b98b9d834b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:47.681273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:47.681903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:47.682178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:47.682450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] PATH_INFO: `/v3/users/b6bd2cc117e942c2a7e160c8fc66d673` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:47.683579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bd2cc117e942c2a7e160c8fc66d673)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:47.686211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:47.732680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bd2cc117e942c2a7e160c8fc66d673'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.740062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bd2cc117e942c2a7e160c8fc66d673'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.740708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bd2cc117e942c2a7e160c8fc66d673'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.749359 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bd2cc117e942c2a7e160c8fc66d673'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.750061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-cec06ff2-f9b9-47e9-8998-1222ec603a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bd2cc117e942c2a7e160c8fc66d673'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:47.767854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1246/2511] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:47 2022] DELETE /identity/v3/users/b6bd2cc117e942c2a7e160c8fc66d673 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:47.942346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:47.943844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:47.956793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1be8f-3d97-439c-9863-1c510b0eb588 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.013820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.014387 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.014663 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.014929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] PATH_INFO: `/v3/projects/b3a98db54d4943a08567c8545a8d4402` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.016053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a98db54d4943a08567c8545a8d4402)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.017949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.063199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a98db54d4943a08567c8545a8d4402', 'request_id': 'req-b8cb9691-8959-4d13-8780-f76b6537123d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:48.064832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:48.071796 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a98db54d4943a08567c8545a8d4402', 'request_id': 'req-b8cb9691-8959-4d13-8780-f76b6537123d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:48.078398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a98db54d4943a08567c8545a8d4402', 'request_id': 'req-b8cb9691-8959-4d13-8780-f76b6537123d'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:48.088461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] The token cache is being invalidate because project b3a98db54d4943a08567c8545a8d4402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:48.088747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:48.089369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-b8cb9691-8959-4d13-8780-f76b6537123d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:48.091386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1266/2512] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:47 2022] DELETE /identity/v3/projects/b3a98db54d4943a08567c8545a8d4402 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:48.096277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.096560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.096830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.116736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:48.117943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:48.188556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1247/2513] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:48.196310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.196591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.196859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.216697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:48.217885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:48.225524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1267/2514] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:48.229626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.239763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7de98-5546-4739-a8a3-ed951c7f508d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.244309 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.244900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.245175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.245441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.246074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:22:48.246368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.247995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.249424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:48.261914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1248/2515] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:22:48.265936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.274938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a1b0a-6eb8-4a05-9e22-efe1ee374c49 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.280104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.280694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.280975 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.281245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.281877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.283772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.310838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1268/2516] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:22:48.314722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.324566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1112e3-de14-4d56-8e2d-68397729799b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.379237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.379837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.380147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.380422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.381318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.383247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.404615 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1249/2517] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:48.408649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.418593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81b9e2-078b-42f5-b0fe-79e95c6712c7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.423117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.423702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.424009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.424279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.424911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.426477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.436030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1269/2518] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:48.439654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.449423 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754e679-0f0f-4f82-886c-a78c6a0e9cb1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.454868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fee7f4-6e1f-40d5-b9f9-3c812f7cab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.455477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fee7f4-6e1f-40d5-b9f9-3c812f7cab7b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.455758 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fee7f4-6e1f-40d5-b9f9-3c812f7cab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.456065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fee7f4-6e1f-40d5-b9f9-3c812f7cab7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.456747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fee7f4-6e1f-40d5-b9f9-3c812f7cab7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.458365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fee7f4-6e1f-40d5-b9f9-3c812f7cab7b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.470355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1250/2519] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:48.474522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.484324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11cf19-ac62-4481-97c5-58a0a1d7592c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.488841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.489474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.489746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.490009 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] PATH_INFO: `/v3/projects/b971d3433b504cdc82b9cadb85c54750/users/d78119d6f6aa42d98b2762f1ff7fc37e/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.503999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971d3433b504cdc82b9cadb85c54750, user_id=d78119d6f6aa42d98b2762f1ff7fc37e, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.506869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.519802 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1270/2520] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:48 2022] PUT /identity/v3/projects/b971d3433b504cdc82b9cadb85c54750/users/d78119d6f6aa42d98b2762f1ff7fc37e/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:48.530476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.530763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.531038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.558090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] MFA Rules not processed for user `d78119d6f6aa42d98b2762f1ff7fc37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:48.559284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:48.632510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1251/2521] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:48.637034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.697916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5729dc-e423-4d72-aa45-2b2184111496 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.703771 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.704396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.704687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.704952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.705577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.707454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.732906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1271/2522] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:48.736967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.748285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ef2cf-80dd-45e7-8db4-2e4517f22524 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.805486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.806331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.806619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.806880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.807545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.810062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.819187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:48.836651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1252/2523] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:48 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:48.840656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.850741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0895e-bbdb-4e3c-99a0-cfc928fa81c6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.855379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.855998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.856274 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.856550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.857177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.858752 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.870328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1272/2524] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:48.874881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.885133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced7df-0e9f-4ff5-94aa-fbbfb6196cfd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.889870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.890519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.890794 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.891066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] PATH_INFO: `/v3/projects/444f08624d844370a0f55707f33946bf/users/ff68b03ec5e847bc8ab3f405ccbe44b9/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.905819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444f08624d844370a0f55707f33946bf, user_id=ff68b03ec5e847bc8ab3f405ccbe44b9, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.908516 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:48.921409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1253/2525] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:48 2022] PUT /identity/v3/projects/444f08624d844370a0f55707f33946bf/users/ff68b03ec5e847bc8ab3f405ccbe44b9/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:48.925401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:48.935153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7fcb6-4201-47ef-97e9-e5550ba8541e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:48.978226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:48.991597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765af93-f20a-4fe1-b5cc-c62f6e5664a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:48.992232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765af93-f20a-4fe1-b5cc-c62f6e5664a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:48.992513 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765af93-f20a-4fe1-b5cc-c62f6e5664a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:48.992783 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765af93-f20a-4fe1-b5cc-c62f6e5664a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:48.993417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765af93-f20a-4fe1-b5cc-c62f6e5664a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:48.995001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765af93-f20a-4fe1-b5cc-c62f6e5664a0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:49.004475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1273/2526] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:49.008958 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:49.019118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb8c7f-755a-4eff-8596-0708d62e6ea6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:49.023716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:49.024478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:49.024688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:49.024960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] PATH_INFO: `/v3/projects/444f08624d844370a0f55707f33946bf/users/ff68b03ec5e847bc8ab3f405ccbe44b9/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:49.026853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] RBAC: Authorizing `identity:create_grant(project_id=444f08624d844370a0f55707f33946bf, user_id=ff68b03ec5e847bc8ab3f405ccbe44b9, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:49.030090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:49.040020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1254/2527] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:49 2022] PUT /identity/v3/projects/444f08624d844370a0f55707f33946bf/users/ff68b03ec5e847bc8ab3f405ccbe44b9/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:22:49.051124 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:49.051408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:49.051697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:49.080832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] MFA Rules not processed for user `ff68b03ec5e847bc8ab3f405ccbe44b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:49.082043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:49.148549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1274/2528] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:49.159832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:49.161572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:49.218936 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd29a5f-d45b-42e2-a3d0-870a96e0922e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:49.222693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:49.223377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:49.223725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:49.224099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:49.284488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:49.285873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:49.294993 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1255/2529] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:22:50.647228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:50.648639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:50.660306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7863f-ff43-42f9-88ac-b410d64da624 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:50.663779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a956-45de-4b04-8ab0-835d304467fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:50.664414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a956-45de-4b04-8ab0-835d304467fb service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:50.664691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a956-45de-4b04-8ab0-835d304467fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:50.664956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a956-45de-4b04-8ab0-835d304467fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:50.674084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800a956-45de-4b04-8ab0-835d304467fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:50.675488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800a956-45de-4b04-8ab0-835d304467fb service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:50.685374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1275/2530] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:22:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:22:54.448541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:54.510352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42b47d-3d38-4a4d-9d89-f1cf8fd1d411 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:54.515088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:54.515724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:54.516018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:54.516285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] PATH_INFO: `/v3/users/d78119d6f6aa42d98b2762f1ff7fc37e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:54.517904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78119d6f6aa42d98b2762f1ff7fc37e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:54.519833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:54.530204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:54.569763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78119d6f6aa42d98b2762f1ff7fc37e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:54.577476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78119d6f6aa42d98b2762f1ff7fc37e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:54.578141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78119d6f6aa42d98b2762f1ff7fc37e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:54.587086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78119d6f6aa42d98b2762f1ff7fc37e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:54.587743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78119d6f6aa42d98b2762f1ff7fc37e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:54.606072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1256/2531] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:54 2022] DELETE /identity/v3/users/d78119d6f6aa42d98b2762f1ff7fc37e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:54.610692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:54.611148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:54.611243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:54.631961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:54.633167 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:54.689926 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1276/2532] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:54.699544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:54.700983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:54.762442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f655f-9628-45d6-ba76-0f148e3d6cf9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:54.766469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:54.767749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:54.768056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:54.768327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:54.777987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:54.779425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:54.789205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1257/2533] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:22:55.059535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:55.060991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:55.076746 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779afaa-8969-4220-8462-cf2eba2b6f98 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:55.081807 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:55.082622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.082910 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.083259 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] PATH_INFO: `/v3/projects/b971d3433b504cdc82b9cadb85c54750` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.084321 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b971d3433b504cdc82b9cadb85c54750)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:55.086226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:55.133286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b971d3433b504cdc82b9cadb85c54750', 'request_id': 'req-93c750f9-97dc-47d4-bfc7-07ac7566a946'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.135729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:55.142132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b971d3433b504cdc82b9cadb85c54750', 'request_id': 'req-93c750f9-97dc-47d4-bfc7-07ac7566a946'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.149874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b971d3433b504cdc82b9cadb85c54750', 'request_id': 'req-93c750f9-97dc-47d4-bfc7-07ac7566a946'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.160439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] The token cache is being invalidate because project b971d3433b504cdc82b9cadb85c54750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:55.160724 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.161359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.162830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1277/2534] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:55 2022] DELETE /identity/v3/projects/b971d3433b504cdc82b9cadb85c54750 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:55.166904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:55.177150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd99bd-4d09-4189-affd-b09271bac960 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:55.232565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:55.233196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.233472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.233743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] PATH_INFO: `/v3/users/ff68b03ec5e847bc8ab3f405ccbe44b9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.234898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff68b03ec5e847bc8ab3f405ccbe44b9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:55.237473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:55.273270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:55.289240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff68b03ec5e847bc8ab3f405ccbe44b9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.300918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff68b03ec5e847bc8ab3f405ccbe44b9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.301784 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff68b03ec5e847bc8ab3f405ccbe44b9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.309842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff68b03ec5e847bc8ab3f405ccbe44b9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.310603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-594b6b18-2f0e-4900-9a1e-d18cdc92470f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff68b03ec5e847bc8ab3f405ccbe44b9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.329882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1258/2535] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:55 2022] DELETE /identity/v3/users/ff68b03ec5e847bc8ab3f405ccbe44b9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:55.600142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:55.601546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:55.617907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c750f9-97dc-47d4-bfc7-07ac7566a946 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:55.679286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:55.679915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.680226 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.680496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] PATH_INFO: `/v3/projects/444f08624d844370a0f55707f33946bf` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.681591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=444f08624d844370a0f55707f33946bf)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:55.683539 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:55.728405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444f08624d844370a0f55707f33946bf', 'request_id': 'req-7aba0f2e-574f-4d62-a96e-4de14809aaab'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.736398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444f08624d844370a0f55707f33946bf', 'request_id': 'req-7aba0f2e-574f-4d62-a96e-4de14809aaab'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.743033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444f08624d844370a0f55707f33946bf', 'request_id': 'req-7aba0f2e-574f-4d62-a96e-4de14809aaab'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.753548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] The token cache is being invalidate because project 444f08624d844370a0f55707f33946bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:55.753833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.754459 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-7aba0f2e-574f-4d62-a96e-4de14809aaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:55.756221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1278/2536] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:55 2022] DELETE /identity/v3/projects/444f08624d844370a0f55707f33946bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:55.761043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.761498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.761622 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.783011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:55.783980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:55.842362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1259/2537] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:55.850874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.851162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.851439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.871494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:55.872760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:55.881338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1279/2538] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:55.885663 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:55.896052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d55dc-b727-48cb-9f0e-02f76131c7d7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:55.900644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:55.901244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.901524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.901796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.902466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:22:55.902768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:55.904389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:55.916488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1260/2539] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:22:55.920624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:55.929725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbd7e0-e4db-41b0-8934-e4194560a203 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:55.934329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:55.934920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:55.935201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:55.935477 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:55.936147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:55.938042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:55.965498 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1280/2540] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:55 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:55.969697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:55.980210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9712922-f804-4ce7-9fdc-743fcadd168f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.035580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.036161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.036466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.036741 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.037362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.039289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.060295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1261/2541] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:55 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:22:56.064436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.074825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c3894-d34b-457a-8b09-87a7371097db admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.079900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.080518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.080790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.081054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.081682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.083254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.092963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1281/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:56.097568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.107495 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64337b36-4b11-4f67-94c4-a6d12f72e2f1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.112133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273793b-d147-445b-9604-cd8c0e2e5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.112732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273793b-d147-445b-9604-cd8c0e2e5874 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.113008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273793b-d147-445b-9604-cd8c0e2e5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.113283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273793b-d147-445b-9604-cd8c0e2e5874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.113924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273793b-d147-445b-9604-cd8c0e2e5874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.115528 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273793b-d147-445b-9604-cd8c0e2e5874 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.126721 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1262/2543] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:56.131147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.141147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f685-63fe-4360-b656-c4ccbaa49a86 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.146424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.147100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.147377 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.147673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] PATH_INFO: `/v3/projects/04a9b10a4ec74d1ab7b5c642e90f9a65/users/6d5e87490e6c4ca4a70b52bdcdf54ed6/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.161919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a9b10a4ec74d1ab7b5c642e90f9a65, user_id=6d5e87490e6c4ca4a70b52bdcdf54ed6, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.164594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.177862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1282/2544] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:56 2022] PUT /identity/v3/projects/04a9b10a4ec74d1ab7b5c642e90f9a65/users/6d5e87490e6c4ca4a70b52bdcdf54ed6/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:56.188064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.188343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.189169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.216629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] MFA Rules not processed for user `6d5e87490e6c4ca4a70b52bdcdf54ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:56.217833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:56.221810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:56.285492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1263/2545] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:56.289988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.298630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:56.350982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c401-0dd6-482c-8cbe-d715c652e665 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.355593 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.356216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.356495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.356767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.357398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.359291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.385030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1283/2546] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:56 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:56.389076 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.401338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef064c-7b09-43ed-bc69-7e4418c0bc5b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.458101 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.458708 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.458981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.459250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.459878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.461826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.483009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1264/2547] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:56 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:56.487621 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.497731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ca82a-371b-4615-9606-0f7713bb418a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.502911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.503511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.503792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.504105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.504747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.506589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.516956 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1284/2548] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:56.520884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.530530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913de70f-3015-4c22-8fd9-9a729643b1fc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.535110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.535747 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.536052 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.536323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] PATH_INFO: `/v3/projects/a032962666d24ee3bfde33d49c06f36a/users/5fb2eb02a7c64ca38ee959a1ae59becb/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.551218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a032962666d24ee3bfde33d49c06f36a, user_id=5fb2eb02a7c64ca38ee959a1ae59becb, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.553823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.567430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1265/2549] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:56 2022] PUT /identity/v3/projects/a032962666d24ee3bfde33d49c06f36a/users/5fb2eb02a7c64ca38ee959a1ae59becb/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:56.571711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.581821 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5400-3061-41b4-b324-2f3d869fe8be admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.639376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9a4e6-6578-4393-a7dc-8164c5fd102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.640077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a4e6-6578-4393-a7dc-8164c5fd102a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.640268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a4e6-6578-4393-a7dc-8164c5fd102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.640533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a4e6-6578-4393-a7dc-8164c5fd102a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.641159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9a4e6-6578-4393-a7dc-8164c5fd102a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.642750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9a4e6-6578-4393-a7dc-8164c5fd102a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.652234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1285/2550] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:56.656324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.666327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0875-e1ee-4b9b-80a4-a9eda38f92af admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.670860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.671499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.671771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.672075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] PATH_INFO: `/v3/projects/a032962666d24ee3bfde33d49c06f36a/users/5fb2eb02a7c64ca38ee959a1ae59becb/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.674459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a032962666d24ee3bfde33d49c06f36a, user_id=5fb2eb02a7c64ca38ee959a1ae59becb, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.677088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.687063 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1266/2551] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:56 2022] PUT /identity/v3/projects/a032962666d24ee3bfde33d49c06f36a/users/5fb2eb02a7c64ca38ee959a1ae59becb/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:56.698720 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.699010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.699317 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.726313 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] MFA Rules not processed for user `5fb2eb02a7c64ca38ee959a1ae59becb`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:56.727522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:56.794871 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1286/2552] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:56.807842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:56.809648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:56.866664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471c64e-289c-4357-8cdc-b59093a9952e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:56.870392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:56.870992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:56.871266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:56.871534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:56.881463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:56.882882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:56.888019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:56.893202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1267/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:22:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:22:57.198162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:57.202547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:57.208453 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26204667-0632-472f-88fc-0ce94297fb5a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:57.213466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb2eb02a7c64ca38ee959a1ae59becb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a032962666d24ee3bfde33d49c06f36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:57.214078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:57.214343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:57.214615 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:57.215254 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:22:57.215644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:57.217324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:57.229108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1287/2554] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:22:57.233277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:57.243184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f43f15-85eb-48b8-b8f2-5c1a8ca7cffa service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:57.247854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb2eb02a7c64ca38ee959a1ae59becb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a032962666d24ee3bfde33d49c06f36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:57.248482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:57.248757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:57.249026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:57.249642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:57.251560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:57.278126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1268/2555] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:57 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:57.282776 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:57.292480 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ae3ba-4d7e-4f88-b453-c76110413b0e tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:57.347344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb2eb02a7c64ca38ee959a1ae59becb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a032962666d24ee3bfde33d49c06f36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:57.348002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:57.348291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:57.348569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:57.349210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:22:57.349517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:57.351113 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:57.362588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1288/2556] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:22:57.400543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:57.411168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d00c-ad74-419e-9d2a-52a54227ccbf tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:57.415717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb2eb02a7c64ca38ee959a1ae59becb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a032962666d24ee3bfde33d49c06f36a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:57.416360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:57.416638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:57.416903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] PATH_INFO: `/v3/projects/84ade44e45c442b09a0d74cff7751210` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:57.418004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorizing `identity:delete_project(project_id=84ade44e45c442b09a0d74cff7751210)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:57.419889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:57.464209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ade44e45c442b09a0d74cff7751210', 'request_id': 'req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.471218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ade44e45c442b09a0d74cff7751210', 'request_id': 'req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.477883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ade44e45c442b09a0d74cff7751210', 'request_id': 'req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.488444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] The token cache is being invalidate because project 84ade44e45c442b09a0d74cff7751210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:57.488727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.489352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8b292d83-48d8-4325-b5c9-d0c5bd15f2c6 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.490818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1269/2557] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:57 2022] DELETE /identity/v3/projects/84ade44e45c442b09a0d74cff7751210 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:57.676878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:57.678596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:57.741590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988464-1227-4aea-b841-b92bb7a07f65 tempest-VolumeQuotaClassesTest-584009995 tempest-VolumeQuotaClassesTest-584009995-project-admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:57.794860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:57.795484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:57.795761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:57.796062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] PATH_INFO: `/v3/users/6d5e87490e6c4ca4a70b52bdcdf54ed6` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:57.797168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5e87490e6c4ca4a70b52bdcdf54ed6)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:57.799654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:57.833220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:57.846383 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5e87490e6c4ca4a70b52bdcdf54ed6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.847035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5e87490e6c4ca4a70b52bdcdf54ed6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.853820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5e87490e6c4ca4a70b52bdcdf54ed6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.854445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5e87490e6c4ca4a70b52bdcdf54ed6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.862316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5e87490e6c4ca4a70b52bdcdf54ed6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:57.879707 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1289/2558] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:57 2022] DELETE /identity/v3/users/6d5e87490e6c4ca4a70b52bdcdf54ed6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:57.884582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:57.885046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:57.885161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:57.906981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:57.908666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:57.965056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1270/2559] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:57.975146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:57.976540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:58.032728 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b585-d558-42da-996c-62aad52b74c2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:58.036288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:58.036882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:58.037156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:58.037423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:58.046066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:58.047470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:58.056580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1290/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:22:58.320843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:58.322268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:58.335279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc411b9-d723-44e5-87b7-54c5002fd50a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:58.339866 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:58.340534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:58.340819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:58.341096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] PATH_INFO: `/v3/projects/04a9b10a4ec74d1ab7b5c642e90f9a65` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:58.342243 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a9b10a4ec74d1ab7b5c642e90f9a65)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:58.344174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:58.390606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a9b10a4ec74d1ab7b5c642e90f9a65', 'request_id': 'req-84dd33c2-ceec-4956-a04f-87aef074d5b4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.397205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a9b10a4ec74d1ab7b5c642e90f9a65', 'request_id': 'req-84dd33c2-ceec-4956-a04f-87aef074d5b4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.399686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:58.404912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a9b10a4ec74d1ab7b5c642e90f9a65', 'request_id': 'req-84dd33c2-ceec-4956-a04f-87aef074d5b4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.415779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] The token cache is being invalidate because project 04a9b10a4ec74d1ab7b5c642e90f9a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:58.416114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.416738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.418223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1271/2561] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:58 2022] DELETE /identity/v3/projects/04a9b10a4ec74d1ab7b5c642e90f9a65 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:58.422164 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:58.431863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93afdc-e5be-45e0-b708-7f6003536779 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:58.488338 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:58.489215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:58.489494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:58.489763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] PATH_INFO: `/v3/users/5fb2eb02a7c64ca38ee959a1ae59becb` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:58.490870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb2eb02a7c64ca38ee959a1ae59becb)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:58.492823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:58.537252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb2eb02a7c64ca38ee959a1ae59becb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.537918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb2eb02a7c64ca38ee959a1ae59becb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.543093 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:58.545177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb2eb02a7c64ca38ee959a1ae59becb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.546038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb2eb02a7c64ca38ee959a1ae59becb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.554147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-eb891f10-367e-4a6b-a4d1-6f9e9c840d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb2eb02a7c64ca38ee959a1ae59becb'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.571292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1291/2562] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:22:58 2022] DELETE /identity/v3/users/5fb2eb02a7c64ca38ee959a1ae59becb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:58.839496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:58.841042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:58.854979 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd33c2-ceec-4956-a04f-87aef074d5b4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:58.913140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:58.913843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:58.914038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:58.914308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] PATH_INFO: `/v3/projects/a032962666d24ee3bfde33d49c06f36a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:58.915411 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a032962666d24ee3bfde33d49c06f36a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:58.917334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:58.962488 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a032962666d24ee3bfde33d49c06f36a', 'request_id': 'req-1398300a-d509-4d27-987c-8f2cf18f216d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.968490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a032962666d24ee3bfde33d49c06f36a', 'request_id': 'req-1398300a-d509-4d27-987c-8f2cf18f216d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.976489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a032962666d24ee3bfde33d49c06f36a', 'request_id': 'req-1398300a-d509-4d27-987c-8f2cf18f216d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.986744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] The token cache is being invalidate because project a032962666d24ee3bfde33d49c06f36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:22:58.987032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.987661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1398300a-d509-4d27-987c-8f2cf18f216d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:22:58.989136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1272/2563] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:22:58 2022] DELETE /identity/v3/projects/a032962666d24ee3bfde33d49c06f36a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:58.993955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:58.994401 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:58.994511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.013723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:59.014849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:59.073644 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1292/2564] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:59.081845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.082123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.082396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.103246 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:59.104451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:59.112110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1273/2565] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:59.116214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.126450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26fa04-6157-4fa1-88c3-4e82054c7c39 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.131289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.131878 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.132191 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.132465 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.133104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:22:59.133405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.134983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.146874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1293/2566] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:22:59.150972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.159956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717107-6ca3-4cd8-b5e8-45b2e2ead32b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.164486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.165068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.165341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.165606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.166221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.168112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.194070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1274/2567] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:59.198187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.208813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7535b-583f-45e2-a902-2661073e6e8e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.264307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.264836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.265112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.265382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.266016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.268641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.288618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1294/2568] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:59.292843 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.303025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ccac-7c19-4c5e-b7cb-f51e684ba432 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.307533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.308164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.308436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.308700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.309330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.310897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.321469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1275/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:59.325308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.335575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ec11-c536-4e60-9fbf-2a47e12ced6b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.340147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adebaa0-cfb0-4531-9620-8479b375dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.340730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adebaa0-cfb0-4531-9620-8479b375dcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.341007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adebaa0-cfb0-4531-9620-8479b375dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.341278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adebaa0-cfb0-4531-9620-8479b375dcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.341909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adebaa0-cfb0-4531-9620-8479b375dcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.343475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adebaa0-cfb0-4531-9620-8479b375dcb0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.353725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1295/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:59.357737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.367406 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0fdfe-b11b-4867-827d-80536c4483cf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.371952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.372598 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.372875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.373143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] PATH_INFO: `/v3/projects/2c1adf3260f844a0becdfb159551ad54/users/3b49dea4c44d4d72960e9cc2b99b5500/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.388156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1adf3260f844a0becdfb159551ad54, user_id=3b49dea4c44d4d72960e9cc2b99b5500, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.390770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.403576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1276/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:59 2022] PUT /identity/v3/projects/2c1adf3260f844a0becdfb159551ad54/users/3b49dea4c44d4d72960e9cc2b99b5500/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:59.414651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.414939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.415215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.442347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] MFA Rules not processed for user `3b49dea4c44d4d72960e9cc2b99b5500`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:59.443549 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:59.469064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:59.509690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1296/2572] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:59.514197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.526665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:59.576590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f1b4-8bd3-43f2-a699-03502fe67732 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.581688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.582278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.582553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.582841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.583444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.585355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.611187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1277/2573] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:22:59.615739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.627242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c079b9-89c8-4567-9f2c-41b1a1e65b20 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.686482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.687090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.687369 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.687642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.688308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.690218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.710423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1297/2574] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:22:59.714428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.725126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a77bc-f7b3-40d1-9e21-6249b2a80c3e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.729737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.730331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.730610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.730878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.731512 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.733134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.743341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1278/2575] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:59.746986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.756772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182924e-20a9-4faa-9085-2f3a227ec07d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.761260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1354ab8-ba2f-4176-a50a-05014f4fe844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.761844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354ab8-ba2f-4176-a50a-05014f4fe844 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.762120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354ab8-ba2f-4176-a50a-05014f4fe844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.762398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354ab8-ba2f-4176-a50a-05014f4fe844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.763030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1354ab8-ba2f-4176-a50a-05014f4fe844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.764637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1354ab8-ba2f-4176-a50a-05014f4fe844 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.775198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1298/2576] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:22:59.779437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.789766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad99e7-2ee5-4466-9a25-5081a7ef7280 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.794353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:22:59.794987 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.795262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.795531 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] PATH_INFO: `/v3/projects/e1f14fff3bf84fc4a526069e3aa853e0/users/dd4631ef8272468ca387393f6fe8c8f9/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.810133 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f14fff3bf84fc4a526069e3aa853e0, user_id=dd4631ef8272468ca387393f6fe8c8f9, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:22:59.812835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:22:59.825141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1279/2577] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:22:59 2022] PUT /identity/v3/projects/e1f14fff3bf84fc4a526069e3aa853e0/users/dd4631ef8272468ca387393f6fe8c8f9/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:22:59.835973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:22:59.836267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:22:59.836552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:22:59.864328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] MFA Rules not processed for user `dd4631ef8272468ca387393f6fe8c8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:22:59.865531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:22:59.929905 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1299/2578] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:22:59.934522 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:22:59.994885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a1d7a-4970-4eca-9594-7175c1dfe93f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:22:59.999463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.000096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.000373 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.000640 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.001770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.003644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.029648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1280/2579] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:22:59 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:00.033761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:00.044287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9bee6-88e7-43e8-8d4f-afc80beaeca5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:00.076408 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:00.101427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.102025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.102303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.102575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.103205 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.105154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.126482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1300/2580] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:00 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:00.130946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:00.141147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf482-0bda-479a-8e23-0dd91dff1c89 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:00.146473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.147103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.147381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.147652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.148330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.149914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.160331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1281/2581] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:00.164246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:00.173853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6387a4-2473-4e28-b9f3-e0d5c6a4a107 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:00.178403 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.179040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.179318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.179590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] PATH_INFO: `/v3/projects/1ba4bb24928d44e387d396adb466a746/users/a4d88e064df042b79bdcaa9e6e2ff5fc/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.194934 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba4bb24928d44e387d396adb466a746, user_id=a4d88e064df042b79bdcaa9e6e2ff5fc, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.197745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.210660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1301/2582] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:00 2022] PUT /identity/v3/projects/1ba4bb24928d44e387d396adb466a746/users/a4d88e064df042b79bdcaa9e6e2ff5fc/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:23:00.214501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:00.224592 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18683600-bc6f-4acb-baab-10e1ca271746 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:00.257197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:00.282184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b7a5f-74dd-481c-a251-8bd9acb1605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.282720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7a5f-74dd-481c-a251-8bd9acb1605e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.282994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7a5f-74dd-481c-a251-8bd9acb1605e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.283260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b7a5f-74dd-481c-a251-8bd9acb1605e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.283910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b7a5f-74dd-481c-a251-8bd9acb1605e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.285661 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b7a5f-74dd-481c-a251-8bd9acb1605e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.295292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1282/2583] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:00.299856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:00.309738 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9440d2-336f-4dce-92b8-716465efaebb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:00.314884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.315518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.315793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.316100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] PATH_INFO: `/v3/projects/1ba4bb24928d44e387d396adb466a746/users/a4d88e064df042b79bdcaa9e6e2ff5fc/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.317967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba4bb24928d44e387d396adb466a746, user_id=a4d88e064df042b79bdcaa9e6e2ff5fc, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.320607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.330394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1302/2584] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:00 2022] PUT /identity/v3/projects/1ba4bb24928d44e387d396adb466a746/users/a4d88e064df042b79bdcaa9e6e2ff5fc/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:00.340387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.340674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.341004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.368252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] MFA Rules not processed for user `a4d88e064df042b79bdcaa9e6e2ff5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:00.369449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:00.435166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1283/2585] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:00.446907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:00.448585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:00.503983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa548e-43a2-4b53-9cd1-2740d0b2b72d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:00.507797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:00.508410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:00.508685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:00.508951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:00.517562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:00.518967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:00.527965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1303/2586] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:01.018178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:01.019558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:01.031402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc15f-9a7b-4b20-8ae8-399bf52bed18 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:01.035526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:01.036155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:01.036433 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:01.036703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:01.095811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:01.097207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:01.106244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1284/2587] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:05.107478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:05.116483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68740d-24b3-4a20-a967-33f9dd1866e3 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:05.120291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adf27f-60e3-47f5-ba12-b77f66898179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:05.120877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adf27f-60e3-47f5-ba12-b77f66898179 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:05.121151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adf27f-60e3-47f5-ba12-b77f66898179 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:05.121416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adf27f-60e3-47f5-ba12-b77f66898179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:05.177008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adf27f-60e3-47f5-ba12-b77f66898179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:05.178344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adf27f-60e3-47f5-ba12-b77f66898179 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:05.187456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1304/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:07.247737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:07.304847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:07.310992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984e7c-f5a1-4194-8da3-77e8a66bc992 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:07.315448 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:07.316093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:07.316369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:07.316638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] PATH_INFO: `/v3/users/3b49dea4c44d4d72960e9cc2b99b5500` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:07.317738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b49dea4c44d4d72960e9cc2b99b5500)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:07.319652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:07.364350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b49dea4c44d4d72960e9cc2b99b5500'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.371164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b49dea4c44d4d72960e9cc2b99b5500'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.371782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b49dea4c44d4d72960e9cc2b99b5500'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.379214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b49dea4c44d4d72960e9cc2b99b5500'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.379877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b49dea4c44d4d72960e9cc2b99b5500'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.397835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1285/2589] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:07 2022] DELETE /identity/v3/users/3b49dea4c44d4d72960e9cc2b99b5500 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:07.402284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:07.402734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:07.402829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:07.421029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:07.422211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:07.445518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:07.481149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1305/2590] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:07.490591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:07.492068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:07.548341 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298833-3f31-4792-8201-a527be082d66 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:07.551974 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:07.552581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:07.552858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:07.553127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:07.561954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:07.563926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:07.573086 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1286/2591] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:07.841201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:07.842922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:07.856585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb9c09-9055-4008-a126-a2e9ec101f55 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:07.861622 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:07.862248 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:07.862527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:07.863326 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] PATH_INFO: `/v3/projects/2c1adf3260f844a0becdfb159551ad54` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:07.864626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1adf3260f844a0becdfb159551ad54)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:07.866511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:07.911884 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1adf3260f844a0becdfb159551ad54', 'request_id': 'req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.918913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1adf3260f844a0becdfb159551ad54', 'request_id': 'req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.925797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1adf3260f844a0becdfb159551ad54', 'request_id': 'req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.935760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] The token cache is being invalidate because project 2c1adf3260f844a0becdfb159551ad54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:07.936078 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.936704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:07.938839 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1306/2592] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:07 2022] DELETE /identity/v3/projects/2c1adf3260f844a0becdfb159551ad54 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:07.942841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:07.953227 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a8114-fb0b-48dc-aaa1-899f8b0a694b service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:08.008754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:08.009381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:08.009777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:08.010057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] PATH_INFO: `/v3/users/dd4631ef8272468ca387393f6fe8c8f9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:08.011175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4631ef8272468ca387393f6fe8c8f9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:08.013107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:08.036692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:08.062786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4631ef8272468ca387393f6fe8c8f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.070556 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4631ef8272468ca387393f6fe8c8f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.071284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4631ef8272468ca387393f6fe8c8f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.078108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4631ef8272468ca387393f6fe8c8f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.078776 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4631ef8272468ca387393f6fe8c8f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.096108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1287/2593] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:07 2022] DELETE /identity/v3/users/dd4631ef8272468ca387393f6fe8c8f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:08.371834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:08.373446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:08.386846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe8b7c-72c1-445c-9d75-3cfa9cc91b07 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:08.443241 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:08.443869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:08.444180 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:08.444454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] PATH_INFO: `/v3/projects/e1f14fff3bf84fc4a526069e3aa853e0` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:08.445558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f14fff3bf84fc4a526069e3aa853e0)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:08.447440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:08.492627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f14fff3bf84fc4a526069e3aa853e0', 'request_id': 'req-cc266adf-1a9d-481e-967d-03452a4719f1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.496141 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:08.500291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f14fff3bf84fc4a526069e3aa853e0', 'request_id': 'req-cc266adf-1a9d-481e-967d-03452a4719f1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.508709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f14fff3bf84fc4a526069e3aa853e0', 'request_id': 'req-cc266adf-1a9d-481e-967d-03452a4719f1'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.519356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] The token cache is being invalidate because project e1f14fff3bf84fc4a526069e3aa853e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:08.519648 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.520413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.522023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1307/2594] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:08 2022] DELETE /identity/v3/projects/e1f14fff3bf84fc4a526069e3aa853e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:08.526037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:08.527569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:08.540326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dd211-4331-4883-aed8-1de9233e2228 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:08.596692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:08.597262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:08.597581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:08.597848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] PATH_INFO: `/v3/users/a4d88e064df042b79bdcaa9e6e2ff5fc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:08.599061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d88e064df042b79bdcaa9e6e2ff5fc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:08.601055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:08.646746 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d88e064df042b79bdcaa9e6e2ff5fc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.653693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d88e064df042b79bdcaa9e6e2ff5fc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.654316 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d88e064df042b79bdcaa9e6e2ff5fc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.661292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d88e064df042b79bdcaa9e6e2ff5fc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.661992 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a09cedd6-425e-4b22-830f-be13cc21b072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d88e064df042b79bdcaa9e6e2ff5fc'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:08.680529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1288/2595] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:08 2022] DELETE /identity/v3/users/a4d88e064df042b79bdcaa9e6e2ff5fc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:08.945086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:08.946509 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:08.960385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc266adf-1a9d-481e-967d-03452a4719f1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.017478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.018102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.018379 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.018650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] PATH_INFO: `/v3/projects/1ba4bb24928d44e387d396adb466a746` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.019750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba4bb24928d44e387d396adb466a746)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.021674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.069149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba4bb24928d44e387d396adb466a746', 'request_id': 'req-83700cb1-9130-41ab-9290-8c4a5a63b6bd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:09.076182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba4bb24928d44e387d396adb466a746', 'request_id': 'req-83700cb1-9130-41ab-9290-8c4a5a63b6bd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:09.082378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba4bb24928d44e387d396adb466a746', 'request_id': 'req-83700cb1-9130-41ab-9290-8c4a5a63b6bd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:09.092548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] The token cache is being invalidate because project 1ba4bb24928d44e387d396adb466a746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:09.092789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:09.093466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-83700cb1-9130-41ab-9290-8c4a5a63b6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:09.095468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1308/2596] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:08 2022] DELETE /identity/v3/projects/1ba4bb24928d44e387d396adb466a746 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:09.101505 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.101796 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.102107 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.122229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:09.123357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:09.133094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:09.185907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1289/2597] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:09.194394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.194692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.194964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.213985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:09.215178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:09.223374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1309/2598] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:23:09.227562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.237956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df9ab5-7e18-4c4d-a7e8-c048d808b1a9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.242742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.243371 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.243696 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.244094 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.244742 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:09.245046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.246638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.258645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1290/2599] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:23:09.262948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.272633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3886ea-2c30-475f-a1b1-6845f03bb66f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.277285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.277877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.278156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.278433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.279137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.281070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.307855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1310/2600] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:09 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:09.312017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.321805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870719-5c5f-4b46-81b2-db92f6bf618b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.375697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.376251 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.376527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.376798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.377416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.379310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.400714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1291/2601] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:09 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:09.404946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.415709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f63279-a5ed-4e54-850d-a9a1dd85f72d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.420487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.421082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.421361 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.421634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.422270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.423848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.433571 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1311/2602] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:09.437312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.447362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef688e-9315-4ce0-b892-50d478b9412f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.452064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b6158-4957-4739-b5f7-b7dbf10273a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.452649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6158-4957-4739-b5f7-b7dbf10273a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.452923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6158-4957-4739-b5f7-b7dbf10273a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.453191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6158-4957-4739-b5f7-b7dbf10273a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.454339 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b6158-4957-4739-b5f7-b7dbf10273a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.455897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b6158-4957-4739-b5f7-b7dbf10273a4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.466180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1292/2603] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:09.470841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.480426 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b769-a63e-4915-95a5-b4258eb1f2d8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.484964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.485600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.485876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.486148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] PATH_INFO: `/v3/projects/cfb3b8f828374e798ba8ae8d99680c47/users/c4f4f4a70d994b07ab98c64b07794688/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.500889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb3b8f828374e798ba8ae8d99680c47, user_id=c4f4f4a70d994b07ab98c64b07794688, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.503503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.516986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1312/2604] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:09 2022] PUT /identity/v3/projects/cfb3b8f828374e798ba8ae8d99680c47/users/c4f4f4a70d994b07ab98c64b07794688/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:09.527842 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.528326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.528445 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.555565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] MFA Rules not processed for user `c4f4f4a70d994b07ab98c64b07794688`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:09.556781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:09.622749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1293/2605] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:09.634917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:09.636729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:09.647701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:09.694835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dbcff-202a-427b-a686-6d126b9b6d5e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:09.699420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:09.700083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:09.700364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:09.700637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:09.708734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:09.710143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:09.718649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1313/2606] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:19.619402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:19.714790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=22 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:21.813674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:21.815060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:21.887688 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ec715-fd54-4bab-a46c-6f81235f5ad9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:21.893154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:21.893754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:21.894028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:21.894296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:21.896548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:21.952963 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:21.954482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:21.964074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1294/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:23.384097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:23.385505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:23.441288 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0081-33c9-48ad-983e-bdf4cc6e08ee service glance] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:23.445449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:23.446041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:23.446314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:23.446577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:23.448281 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:23.461034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:23.462432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f32f16-fdf0-4e63-ae9b-e1b0a097df72 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:23.473145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1314/2608] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:24.158312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:24.219618 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb328e-4217-45c9-8d12-c542bc8bbba7 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:24.224814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:24.225447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:24.225725 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:24.225998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] PATH_INFO: `/v3/users/c4f4f4a70d994b07ab98c64b07794688` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:24.227241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f4f4a70d994b07ab98c64b07794688)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:24.229192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:24.274215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:24.281144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f4f4a70d994b07ab98c64b07794688'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.288315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f4f4a70d994b07ab98c64b07794688'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.289114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f4f4a70d994b07ab98c64b07794688'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.295822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f4f4a70d994b07ab98c64b07794688'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.296431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f4f4a70d994b07ab98c64b07794688'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.313376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1295/2609] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:24 2022] DELETE /identity/v3/users/c4f4f4a70d994b07ab98c64b07794688 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:24.318004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:24.318291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:24.318568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:24.337712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:24.338920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:24.396251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1315/2610] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:24.405697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:24.407250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:24.464815 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ff440-ed19-4723-801a-c8a9d265a91c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:24.468470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37891252-da7f-4602-9d4f-77b0cdf27e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:24.469069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891252-da7f-4602-9d4f-77b0cdf27e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:24.469342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891252-da7f-4602-9d4f-77b0cdf27e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:24.469606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37891252-da7f-4602-9d4f-77b0cdf27e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:24.478991 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37891252-da7f-4602-9d4f-77b0cdf27e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:24.480451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37891252-da7f-4602-9d4f-77b0cdf27e6b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:24.489589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1296/2611] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:24.770038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:24.772092 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:24.784284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f96552-bd25-4638-90d9-a89e30519cfa None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:24.789177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:24.790323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:24.790534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:24.790818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] PATH_INFO: `/v3/projects/cfb3b8f828374e798ba8ae8d99680c47` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:24.792047 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb3b8f828374e798ba8ae8d99680c47)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:24.794104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:24.848685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb3b8f828374e798ba8ae8d99680c47', 'request_id': 'req-c2c15765-8635-4557-a95d-338ff3ad137c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.856576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb3b8f828374e798ba8ae8d99680c47', 'request_id': 'req-c2c15765-8635-4557-a95d-338ff3ad137c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.863318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb3b8f828374e798ba8ae8d99680c47', 'request_id': 'req-c2c15765-8635-4557-a95d-338ff3ad137c'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.874307 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] The token cache is being invalidate because project cfb3b8f828374e798ba8ae8d99680c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:24.874599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.875256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-c2c15765-8635-4557-a95d-338ff3ad137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:24.877000 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1316/2612] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:24 2022] DELETE /identity/v3/projects/cfb3b8f828374e798ba8ae8d99680c47 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:24.882463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:24.882748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:24.883016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:24.902956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:24.904199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:24.970276 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1297/2613] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:25.032655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.032947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.033225 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.034611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.036034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:25.053548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:25.054749 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:25.063040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1317/2614] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:25.067277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.077382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303cc6c-dec2-4f2b-b027-9bdef632dac8 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.082147 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.082815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.083190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.083523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.084256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:25.084695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.086324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.093293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f4cd-258d-48a7-ade9-34e4abff5123 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.097538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.097812 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1318/2615] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:23:25.098144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.098416 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.098684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.100425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:25.101988 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.111378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7c57-d1fe-492f-bcaf-764c163dd8d3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.113575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:25.116623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.117203 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.117483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.117756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.118382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.120574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.125258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:25.151003 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1319/2616] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:25.155014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.179530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.181036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.193299 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1298/2617] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:23:25.220569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87e0e-2c0b-4de1-a7ad-3415338a56fb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.225919 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.226560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.226863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.227137 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.227768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.229748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.253863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1320/2618] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:25.258189 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.269228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ef35a-f2f1-4839-92ac-70885e49cc3a service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.273847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.274458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.274730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.275000 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.275667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.277344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.287860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1299/2619] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:25.291991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.303291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd00cd-a068-4e1f-8d4d-7777f60a9aa5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.309923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9876036-9360-40e6-8fee-d88524c699a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.310294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876036-9360-40e6-8fee-d88524c699a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.310575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876036-9360-40e6-8fee-d88524c699a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.310846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876036-9360-40e6-8fee-d88524c699a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.311523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9876036-9360-40e6-8fee-d88524c699a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.313333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9876036-9360-40e6-8fee-d88524c699a4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.324761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1321/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:25.329139 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.340197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75013-6bcf-4169-b52a-acf496e352e7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.345645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.346327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.346614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.347032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] PATH_INFO: `/v3/projects/6439adc4b0714f6eb6353cf86471134c/users/9065b199a3614a70b8a6cb15ffaaa7a6/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.362267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6439adc4b0714f6eb6353cf86471134c, user_id=9065b199a3614a70b8a6cb15ffaaa7a6, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.365056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.381066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1300/2621] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:25 2022] PUT /identity/v3/projects/6439adc4b0714f6eb6353cf86471134c/users/9065b199a3614a70b8a6cb15ffaaa7a6/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:25.393674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.394007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.394284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.422987 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] MFA Rules not processed for user `9065b199a3614a70b8a6cb15ffaaa7a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:25.424246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:25.488069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1322/2622] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:25.492720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.553559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3db1e5-2f9a-4781-b02a-1bb27754ee59 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.558136 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.558761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.559035 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.559303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.559922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.561841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.588665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1301/2623] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:25.592798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.603360 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e97668-735c-4ca6-95c6-eb2cc424a428 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.654810 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:25.664432 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.665034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.665311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.665585 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.666217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.668230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.691229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1323/2624] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:25.696122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.707674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cae85-1ae5-438c-93b0-44a7568d85ac admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.712576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.713187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.713459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.713732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.714399 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.716059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.727814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1302/2625] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:25.732253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.743253 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b1163-a42a-4c8f-95b8-04fe3bbc0c6d admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.748055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.748711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.748992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.749267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] PATH_INFO: `/v3/projects/7729ef580d5d4ca3a8bb5d3522f15aec/users/cb6cde68b4c146a89fa9cd520da5670f/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.765703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7729ef580d5d4ca3a8bb5d3522f15aec, user_id=cb6cde68b4c146a89fa9cd520da5670f, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.768412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.782773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1324/2626] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:25 2022] PUT /identity/v3/projects/7729ef580d5d4ca3a8bb5d3522f15aec/users/cb6cde68b4c146a89fa9cd520da5670f/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:25.787165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.797552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013670d-a0b4-49f0-bda5-a7bd2d5e58af admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.844803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:25.866108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8809-a71d-46cf-80b4-5aa1094a2f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.866720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8809-a71d-46cf-80b4-5aa1094a2f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.866995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8809-a71d-46cf-80b4-5aa1094a2f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.867295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8809-a71d-46cf-80b4-5aa1094a2f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.867948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8809-a71d-46cf-80b4-5aa1094a2f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.869564 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8809-a71d-46cf-80b4-5aa1094a2f1e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.879171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1303/2627] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:25.883588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:25.893618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852adf2c-1dc2-485e-a1d7-59e0b6a34d2b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:25.898665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:25.899304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.899580 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.899851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] PATH_INFO: `/v3/projects/7729ef580d5d4ca3a8bb5d3522f15aec/users/cb6cde68b4c146a89fa9cd520da5670f/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.901813 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7729ef580d5d4ca3a8bb5d3522f15aec, user_id=cb6cde68b4c146a89fa9cd520da5670f, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:25.904483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:25.915118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1325/2628] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:25 2022] PUT /identity/v3/projects/7729ef580d5d4ca3a8bb5d3522f15aec/users/cb6cde68b4c146a89fa9cd520da5670f/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:25.925095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:25.925380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:25.925657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:25.952593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] MFA Rules not processed for user `cb6cde68b4c146a89fa9cd520da5670f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:25.953799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:26.021155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1304/2629] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:26.031654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:26.033437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:26.091466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a4ad2-c8ef-46dc-8030-70150c7e5984 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:26.095043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f953e-92be-4085-b8e4-f43053ebb584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:26.095640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f953e-92be-4085-b8e4-f43053ebb584 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:26.095915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f953e-92be-4085-b8e4-f43053ebb584 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:26.096210 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f953e-92be-4085-b8e4-f43053ebb584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:26.150471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f953e-92be-4085-b8e4-f43053ebb584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:26.151876 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f953e-92be-4085-b8e4-f43053ebb584 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:26.160645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1326/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:28.688237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:28.759461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167f83-08f4-406f-97fc-e7d0a8051809 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:28.764096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:28.764729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:28.765003 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:28.765296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] PATH_INFO: `/v3/users/9065b199a3614a70b8a6cb15ffaaa7a6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:28.766420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9065b199a3614a70b8a6cb15ffaaa7a6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:28.768404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:28.821508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9065b199a3614a70b8a6cb15ffaaa7a6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:28.831023 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9065b199a3614a70b8a6cb15ffaaa7a6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:28.831529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9065b199a3614a70b8a6cb15ffaaa7a6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:28.839212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9065b199a3614a70b8a6cb15ffaaa7a6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:28.839861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9065b199a3614a70b8a6cb15ffaaa7a6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:28.841026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:28.860800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1305/2631] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:28 2022] DELETE /identity/v3/users/9065b199a3614a70b8a6cb15ffaaa7a6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:28.865795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:28.866292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:28.866399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:28.885635 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:28.886826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:28.937918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:28.948058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1327/2632] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:28.958043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:28.959728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:29.025668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeff11-2a09-407f-8671-a711680659f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:29.029344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:29.030007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:29.030277 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:29.030544 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:29.041456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:29.043082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:29.056731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1306/2633] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:29.322833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:29.325851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:29.421492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:29.424137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:29.448877 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e8301-d6fe-4af8-ae00-6d36adb3ce56 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:29.449200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf4df3-c924-4958-9967-3cc091938d1b None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:29.454092 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:29.454702 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328af90-e710-4315-a446-651935835729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:29.454997 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:29.455282 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:29.455406 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328af90-e710-4315-a446-651935835729 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:29.455587 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328af90-e710-4315-a446-651935835729 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:29.455835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328af90-e710-4315-a446-651935835729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:29.456633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] PATH_INFO: `/v3/projects/6439adc4b0714f6eb6353cf86471134c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:29.457653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e328af90-e710-4315-a446-651935835729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:29.458326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6439adc4b0714f6eb6353cf86471134c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:29.460649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:29.474482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328af90-e710-4315-a446-651935835729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:29.476882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328af90-e710-4315-a446-651935835729 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:29.508316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1328/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:29.519754 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6439adc4b0714f6eb6353cf86471134c', 'request_id': 'req-459d592a-6e50-4688-a40f-1266c04f3676'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.532916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6439adc4b0714f6eb6353cf86471134c', 'request_id': 'req-459d592a-6e50-4688-a40f-1266c04f3676'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.546306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6439adc4b0714f6eb6353cf86471134c', 'request_id': 'req-459d592a-6e50-4688-a40f-1266c04f3676'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.559559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] The token cache is being invalidate because project 6439adc4b0714f6eb6353cf86471134c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:29.559918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.560743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.562409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1307/2635] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:29 2022] DELETE /identity/v3/projects/6439adc4b0714f6eb6353cf86471134c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:23:29.566447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328af90-e710-4315-a446-651935835729 service nova] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:29.577778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328af90-e710-4315-a446-651935835729 service nova] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:29.637799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:29.638560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:29.638841 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:29.639110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] PATH_INFO: `/v3/users/cb6cde68b4c146a89fa9cd520da5670f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:29.640445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6cde68b4c146a89fa9cd520da5670f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:29.642182 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:29.688768 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6cde68b4c146a89fa9cd520da5670f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.689429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6cde68b4c146a89fa9cd520da5670f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.696604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6cde68b4c146a89fa9cd520da5670f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.697346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6cde68b4c146a89fa9cd520da5670f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.705715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-8ffbbdfe-e3bc-4026-872d-ac927101b632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6cde68b4c146a89fa9cd520da5670f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:29.724230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1329/2636] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:29 2022] DELETE /identity/v3/users/cb6cde68b4c146a89fa9cd520da5670f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:30.026859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.028308 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:30.041897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d592a-6e50-4688-a40f-1266c04f3676 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.109730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.110348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.110628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.110938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] PATH_INFO: `/v3/projects/7729ef580d5d4ca3a8bb5d3522f15aec` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.112155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7729ef580d5d4ca3a8bb5d3522f15aec)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.114734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.123297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:30.175340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7729ef580d5d4ca3a8bb5d3522f15aec', 'request_id': 'req-171e433e-168b-48d2-920c-34c42cf6c266'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:30.187116 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7729ef580d5d4ca3a8bb5d3522f15aec', 'request_id': 'req-171e433e-168b-48d2-920c-34c42cf6c266'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:30.196408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7729ef580d5d4ca3a8bb5d3522f15aec', 'request_id': 'req-171e433e-168b-48d2-920c-34c42cf6c266'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:30.212151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] The token cache is being invalidate because project 7729ef580d5d4ca3a8bb5d3522f15aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:30.212489 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:30.213153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-171e433e-168b-48d2-920c-34c42cf6c266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:30.214881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1308/2637] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:30 2022] DELETE /identity/v3/projects/7729ef580d5d4ca3a8bb5d3522f15aec => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:30.219894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.220436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.220671 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.232662 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:30.250049 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:30.251456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:30.319250 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1330/2638] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:30.330234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.330524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.330802 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.353779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:30.355190 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:30.374862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1309/2639] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:30.379110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.389953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8b9d-aced-42e2-a5aa-6df2773051e5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.398392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.399096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.399448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.399798 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.400555 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:30.400930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.402673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.415861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1331/2640] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:23:30.420534 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.430645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee32dea-ca7b-4328-b025-39910604ddb2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.435353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.435977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.436257 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.436526 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.437168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.439078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.467638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1310/2641] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:30 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:30.472303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.483084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92db48-e27b-4be0-87b1-96e5a57cbb1b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.545277 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.545917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.546192 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.546460 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.547088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.549044 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.571053 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1332/2642] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:30 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:30.575578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.586809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fd0ec-d99e-4099-bd3f-77e89440b735 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.591497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.592143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.592480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.592700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.593343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.595049 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.605250 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1311/2643] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:30.609641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.621388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdb0c6-8aae-4968-becb-50343fbdeedb admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.626032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af05f2-8266-46f9-a8a8-7a28ba27c27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.626630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af05f2-8266-46f9-a8a8-7a28ba27c27c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.626903 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af05f2-8266-46f9-a8a8-7a28ba27c27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.627171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af05f2-8266-46f9-a8a8-7a28ba27c27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.627806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af05f2-8266-46f9-a8a8-7a28ba27c27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.629445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af05f2-8266-46f9-a8a8-7a28ba27c27c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.639794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1333/2644] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:23:30.644013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.654867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8892-5178-427c-a7e8-117030c65030 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:30.660176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:30.660856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.661114 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.661543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] PATH_INFO: `/v3/projects/14fe0d15bfd149d39837c334ad334014/users/02b24026a4654cf09d4876587d61dbc0/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.678295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fe0d15bfd149d39837c334ad334014, user_id=02b24026a4654cf09d4876587d61dbc0, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:30.681188 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:30.695025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1312/2645] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:30 2022] PUT /identity/v3/projects/14fe0d15bfd149d39837c334ad334014/users/02b24026a4654cf09d4876587d61dbc0/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:30.705370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:30.705780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:30.706062 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:30.735436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] MFA Rules not processed for user `02b24026a4654cf09d4876587d61dbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:30.736685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:30.813725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:30.817733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1334/2646] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:23:30.829638 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:30.831782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:31.014625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442efb31-f9c3-482f-8e0a-5bbfadc899df admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:31.019041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:31.019687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:31.020014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:31.020764 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:31.030249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:31.031667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:31.040966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1313/2647] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:34.504470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:34.506598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:34.560877 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06ec7d-0855-4bbf-9d37-f37e8a9773e5 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:34.564380 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:34.564970 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:34.565243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:34.565511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:34.567184 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:34.631202 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:34.632661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ee37f-0a23-499b-988b-2e10edd4ebd1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:34.642080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1335/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:36.016686 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:36.028055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e02a12-3e14-4e88-a3e5-ae13afdb2fb7 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:36.032567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:36.033203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:36.033478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:36.033740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] PATH_INFO: `/v3/users/02b24026a4654cf09d4876587d61dbc0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:36.035015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b24026a4654cf09d4876587d61dbc0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:36.037468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:36.077046 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:36.096332 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b24026a4654cf09d4876587d61dbc0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:36.105817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b24026a4654cf09d4876587d61dbc0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:36.106665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b24026a4654cf09d4876587d61dbc0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:36.116612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b24026a4654cf09d4876587d61dbc0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:36.117401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b24026a4654cf09d4876587d61dbc0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:36.140163 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1314/2649] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:36 2022] DELETE /identity/v3/users/02b24026a4654cf09d4876587d61dbc0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:36.141775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:36.142262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:36.142359 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:36.166244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:36.167779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:36.234522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1336/2650] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:23:36.244755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:36.246193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:36.309734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562af090-ebc2-4a53-9aa9-4e27f58d5416 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:36.313415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:36.314025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:36.314430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:36.314706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:36.328828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:36.330294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:36.341356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1315/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:37.060284 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:37.061805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:37.076767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59f9c-1644-4e2b-9a31-387e02c0fef9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:37.082511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:37.083235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:37.084289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:37.084623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] PATH_INFO: `/v3/projects/14fe0d15bfd149d39837c334ad334014` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:37.085907 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fe0d15bfd149d39837c334ad334014)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:37.088531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:37.149819 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:37.153213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fe0d15bfd149d39837c334ad334014', 'request_id': 'req-f1371fe9-fc73-4d90-a544-7ee3de832392'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:37.163014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fe0d15bfd149d39837c334ad334014', 'request_id': 'req-f1371fe9-fc73-4d90-a544-7ee3de832392'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:37.170035 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fe0d15bfd149d39837c334ad334014', 'request_id': 'req-f1371fe9-fc73-4d90-a544-7ee3de832392'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:37.181741 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] The token cache is being invalidate because project 14fe0d15bfd149d39837c334ad334014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:37.182594 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:37.183108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:37.185139 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1337/2652] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:37 2022] DELETE /identity/v3/projects/14fe0d15bfd149d39837c334ad334014 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:37.914431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:37.915884 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:37.928728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ae29-c923-47c2-945f-1c9e46dd975e service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:37.983782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:37.984442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:37.984718 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:37.985013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] PATH_INFO: `/v3/users/5ac2c0f2fcb349c68604724730d274df` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:37.986132 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac2c0f2fcb349c68604724730d274df)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:37.988070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.034334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac2c0f2fcb349c68604724730d274df'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.037770 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:38.041731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac2c0f2fcb349c68604724730d274df'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.042655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac2c0f2fcb349c68604724730d274df'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.051248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac2c0f2fcb349c68604724730d274df'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.051889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8d14b56c-ee0c-4189-b545-bbe97ffbc14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac2c0f2fcb349c68604724730d274df'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.069296 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1316/2653] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:37 2022] DELETE /identity/v3/users/5ac2c0f2fcb349c68604724730d274df => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:38.241538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.243189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:38.258424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1371fe9-fc73-4d90-a544-7ee3de832392 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.314214 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.314863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.315126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.315489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] PATH_INFO: `/v3/projects/54c4a8ecc38f4f7795190dabee5b318f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.316918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c4a8ecc38f4f7795190dabee5b318f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.319335 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.363227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c4a8ecc38f4f7795190dabee5b318f', 'request_id': 'req-d5996d03-1aa4-4986-8b0b-73c200b44a37'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.370939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c4a8ecc38f4f7795190dabee5b318f', 'request_id': 'req-d5996d03-1aa4-4986-8b0b-73c200b44a37'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.377007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c4a8ecc38f4f7795190dabee5b318f', 'request_id': 'req-d5996d03-1aa4-4986-8b0b-73c200b44a37'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.387717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] The token cache is being invalidate because project 54c4a8ecc38f4f7795190dabee5b318f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:38.388033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.388655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-d5996d03-1aa4-4986-8b0b-73c200b44a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:38.390103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1338/2654] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:38 2022] DELETE /identity/v3/projects/54c4a8ecc38f4f7795190dabee5b318f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:23:38.395011 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.395292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.395563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.414634 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:38.415994 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:38.472062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1317/2655] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:23:38.479517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.479799 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.480100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.499760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:38.501073 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:38.509716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1339/2656] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:38.513716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.523097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551a9b5-37fc-4615-9387-b5703d738793 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.527541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.528165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.528440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.528707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.529340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:38.529637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.531201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.542349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1318/2657] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:23:38.546476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.555959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798cbd0-a4a0-41af-bb62-11523018401e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.560523 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.561109 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.561412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.561681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.562306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.564206 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.591398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1340/2658] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:38 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:38.595390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.605065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d538495-904f-4deb-8e16-9c6ce27d732f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.660838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.661441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.662095 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.662369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.663026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.664967 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.685818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1319/2659] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:38 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:38.689995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.700678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b14da-be14-4410-8091-e70702b5f35f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.705199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.705794 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.706079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.706345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.706983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.708608 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.718301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1341/2660] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:38.722165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.732637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b4040-246a-4c0c-8f08-1fe3a6f01f33 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.737192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f284b-01de-463a-92fe-c13084b04cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.737780 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f284b-01de-463a-92fe-c13084b04cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.738057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f284b-01de-463a-92fe-c13084b04cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.738324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f284b-01de-463a-92fe-c13084b04cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.738956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f284b-01de-463a-92fe-c13084b04cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.741191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f284b-01de-463a-92fe-c13084b04cbc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.750736 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1320/2661] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:38.755125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.764734 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2df053-0904-4e44-a970-a78981d67ce6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.769304 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.769937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.770217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.770491 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] PATH_INFO: `/v3/projects/6463d9e547f64d28983726eb10d0a9a9/users/3ffcfed1d155456d8b91b22b664726b1/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.784610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6463d9e547f64d28983726eb10d0a9a9, user_id=3ffcfed1d155456d8b91b22b664726b1, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:38.787772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:38.796200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:38.801299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1342/2662] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:38 2022] PUT /identity/v3/projects/6463d9e547f64d28983726eb10d0a9a9/users/3ffcfed1d155456d8b91b22b664726b1/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:38.812293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.812574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.812850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:38.841207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] MFA Rules not processed for user `3ffcfed1d155456d8b91b22b664726b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:38.842456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:38.866740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:38.908429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1321/2663] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:38.919657 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:38.921443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:38.992279 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af439f-393a-42bc-b427-2285c8831ae9 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:38.997616 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0342d-379f-4860-9be5-b3f18f4da974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:38.998208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0342d-379f-4860-9be5-b3f18f4da974 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:38.998483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0342d-379f-4860-9be5-b3f18f4da974 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:38.998751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0342d-379f-4860-9be5-b3f18f4da974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:39.007157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0342d-379f-4860-9be5-b3f18f4da974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:39.008747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0342d-379f-4860-9be5-b3f18f4da974 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:39.017237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1343/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:41.698852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:41.767072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a0a0-a714-4e10-8d09-72e0c52dc53e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:41.773145 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:41.773768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:41.774038 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:41.774302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] PATH_INFO: `/v3/users/3ffcfed1d155456d8b91b22b664726b1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:41.775407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffcfed1d155456d8b91b22b664726b1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:41.777392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:41.824108 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffcfed1d155456d8b91b22b664726b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:41.832858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffcfed1d155456d8b91b22b664726b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:41.833470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffcfed1d155456d8b91b22b664726b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:41.840908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffcfed1d155456d8b91b22b664726b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:41.841527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffcfed1d155456d8b91b22b664726b1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:41.858469 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1322/2665] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:41 2022] DELETE /identity/v3/users/3ffcfed1d155456d8b91b22b664726b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:41.862931 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:41.863391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:41.863493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:41.884098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:41.885305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:41.948911 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1344/2666] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:41.960451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:41.961838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:42.006088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:42.019597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307589-6be6-4fab-98b1-221fb9764d48 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.024421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfc4a9-da35-4e1f-a15c-95c3d30358f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.025018 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfc4a9-da35-4e1f-a15c-95c3d30358f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.025289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfc4a9-da35-4e1f-a15c-95c3d30358f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.025557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfc4a9-da35-4e1f-a15c-95c3d30358f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.034372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfc4a9-da35-4e1f-a15c-95c3d30358f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.035773 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfc4a9-da35-4e1f-a15c-95c3d30358f7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.045122 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1323/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:42.315958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.317489 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:42.330552 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e48e3f-af7d-4367-844a-e4720d9fa18f None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.335327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.335983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.336262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.336530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] PATH_INFO: `/v3/projects/6463d9e547f64d28983726eb10d0a9a9` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.337661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6463d9e547f64d28983726eb10d0a9a9)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.339545 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.386385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6463d9e547f64d28983726eb10d0a9a9', 'request_id': 'req-aa59d130-5d75-4025-a03c-59c06d7e338a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:42.394195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6463d9e547f64d28983726eb10d0a9a9', 'request_id': 'req-aa59d130-5d75-4025-a03c-59c06d7e338a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:42.400704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6463d9e547f64d28983726eb10d0a9a9', 'request_id': 'req-aa59d130-5d75-4025-a03c-59c06d7e338a'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:42.410760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] The token cache is being invalidate because project 6463d9e547f64d28983726eb10d0a9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:42.411045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:42.411670 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-aa59d130-5d75-4025-a03c-59c06d7e338a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:42.413679 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1345/2668] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:42 2022] DELETE /identity/v3/projects/6463d9e547f64d28983726eb10d0a9a9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:42.419005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.419317 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.419620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.439123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:42.440347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:42.497098 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1324/2669] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:42.506005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.506412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.506691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.526785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:42.528037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:42.535788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1346/2670] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:42.540570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.550156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4606ee-cf0a-471f-b952-9aa7e15020a9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.555236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.555821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.556130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.556398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.557060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:42.557355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.558912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.570087 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1325/2671] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:23:42.574446 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.578889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:42.585920 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65be31-f73b-4afd-b7a0-05af41a13d99 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.591384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.591998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.592278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.592547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.593172 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.595052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.626882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1347/2672] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:42 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:42.628167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.638279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf57c3-4430-415a-be0b-3e0ce60df8ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.691911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.692533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.692805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.693075 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.693698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.695636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.716248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1326/2673] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:42 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:42.720371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.731554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c36c90-dab1-4f42-b33c-61726eb00fde admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.736234 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.736837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.737194 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.737485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.738126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.739731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.750230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1348/2674] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:42.754151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.764632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e2583-02cb-4a4e-9bc6-98ce8646547d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.769257 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a27a8e-6859-42ba-aed4-b2ae11331682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.769846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a27a8e-6859-42ba-aed4-b2ae11331682 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.770123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a27a8e-6859-42ba-aed4-b2ae11331682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.770413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a27a8e-6859-42ba-aed4-b2ae11331682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.771056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a27a8e-6859-42ba-aed4-b2ae11331682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.772658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a27a8e-6859-42ba-aed4-b2ae11331682 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.783177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1327/2675] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:42.787375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.797747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d9c9f-3d53-46e4-9ff0-bc55ac68684c admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:42.802358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:42.803054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.803984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.804268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] PATH_INFO: `/v3/projects/50eb088eeec54a87a61411d36086a263/users/b1409c43e5ce4b56ab2ac4fa51bd47cf/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.818972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50eb088eeec54a87a61411d36086a263, user_id=b1409c43e5ce4b56ab2ac4fa51bd47cf, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:42.821652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:42.836283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1349/2676] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:42 2022] PUT /identity/v3/projects/50eb088eeec54a87a61411d36086a263/users/b1409c43e5ce4b56ab2ac4fa51bd47cf/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:42.846906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:42.847211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:42.847487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:42.875173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] MFA Rules not processed for user `b1409c43e5ce4b56ab2ac4fa51bd47cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:42.876424 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:42.918193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:42.942058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1328/2677] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:42.953072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:42.954853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:43.010955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0b32-d3cf-42aa-95cd-aae6b2f7b6e0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:43.014526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad396a6-b619-4db6-a836-5ab7d6bb7e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:43.015121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad396a6-b619-4db6-a836-5ab7d6bb7e42 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:43.015423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad396a6-b619-4db6-a836-5ab7d6bb7e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:43.015694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad396a6-b619-4db6-a836-5ab7d6bb7e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:43.024588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad396a6-b619-4db6-a836-5ab7d6bb7e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:43.026052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad396a6-b619-4db6-a836-5ab7d6bb7e42 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:43.035060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1350/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:51.383278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:51.444306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345a6bf-144b-4f1a-b51c-0898c35e676f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:51.448759 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:51.449374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:51.449649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:51.449919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] PATH_INFO: `/v3/users/b1409c43e5ce4b56ab2ac4fa51bd47cf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:51.451014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1409c43e5ce4b56ab2ac4fa51bd47cf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:51.452927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:51.497574 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1409c43e5ce4b56ab2ac4fa51bd47cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:51.504753 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1409c43e5ce4b56ab2ac4fa51bd47cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:51.505372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1409c43e5ce4b56ab2ac4fa51bd47cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:51.512248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1409c43e5ce4b56ab2ac4fa51bd47cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:51.512869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1409c43e5ce4b56ab2ac4fa51bd47cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:51.530067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1329/2679] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:51 2022] DELETE /identity/v3/users/b1409c43e5ce4b56ab2ac4fa51bd47cf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:51.534521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:51.535030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:51.535133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:51.554736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:51.555962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:51.612125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1351/2680] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:51.622390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:51.623800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:51.681289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7ecc5-46bb-43ca-ba83-368d4e17a505 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:51.684902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b37e-610c-496a-b211-81def5ddced6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:51.685503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b37e-610c-496a-b211-81def5ddced6 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:51.685781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b37e-610c-496a-b211-81def5ddced6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:51.686053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b37e-610c-496a-b211-81def5ddced6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:51.695435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b37e-610c-496a-b211-81def5ddced6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:51.696881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b37e-610c-496a-b211-81def5ddced6 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:51.706123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1330/2681] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:52.040774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.042217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:52.055333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9ca6f-cd01-4cf3-9476-b050f1ab57e0 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.060680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.060835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.061088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.061364 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] PATH_INFO: `/v3/projects/50eb088eeec54a87a61411d36086a263` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.062541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=50eb088eeec54a87a61411d36086a263)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.064597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.108126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:52.112162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50eb088eeec54a87a61411d36086a263', 'request_id': 'req-21809bca-ae5d-43be-abda-ccb7bd2487ac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:52.120520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50eb088eeec54a87a61411d36086a263', 'request_id': 'req-21809bca-ae5d-43be-abda-ccb7bd2487ac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:52.128050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50eb088eeec54a87a61411d36086a263', 'request_id': 'req-21809bca-ae5d-43be-abda-ccb7bd2487ac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:52.139087 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] The token cache is being invalidate because project 50eb088eeec54a87a61411d36086a263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:52.139375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:52.140032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-21809bca-ae5d-43be-abda-ccb7bd2487ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:52.141514 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1352/2682] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:52 2022] DELETE /identity/v3/projects/50eb088eeec54a87a61411d36086a263 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:52.148307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.148597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.148876 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.157427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:52.168734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:52.169925 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:52.230867 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1331/2683] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:52.238694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.238984 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.239263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.259526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:52.260762 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:52.268689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1353/2684] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:52.272793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.282269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5379285-cb09-4b31-b9c7-f5739c787045 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.286697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.287779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.288082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.288345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.288975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:52.289267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.290826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.301927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1332/2685] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:23:52.306653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.315848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ed738-6544-49b3-9f5d-289f9fc8d6ce None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.320412 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.320995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.321269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.321540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.322199 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.324100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.350452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1354/2686] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:52.354722 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.364631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4e71d-200d-4115-adb3-3034b0078bf5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.419436 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.420070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.420255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.420520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.421142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.423055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.445016 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1333/2687] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:52.449217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.459187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e020-9329-4285-ab3a-3559b22d8172 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.463760 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.464391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.464689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.464943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.465578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.467174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.477325 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1355/2688] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:52.481068 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.491360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee34ecc-37fa-40ba-adf8-204bfe41ded1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.495911 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f426-707d-4393-be87-293b1d7c46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.496521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f426-707d-4393-be87-293b1d7c46fb admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.496795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f426-707d-4393-be87-293b1d7c46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.497064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f426-707d-4393-be87-293b1d7c46fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.497697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f426-707d-4393-be87-293b1d7c46fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.499266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f426-707d-4393-be87-293b1d7c46fb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.510211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1334/2689] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:52.514057 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.523652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bae885-777e-4e88-861a-0a0249747563 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.528240 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.528874 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.529151 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.529420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] PATH_INFO: `/v3/projects/57a630ccd819476cb0e2dc30ad83a284/users/020827bc9e4d4e90ad8904fe447b9c0b/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.545094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a630ccd819476cb0e2dc30ad83a284, user_id=020827bc9e4d4e90ad8904fe447b9c0b, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.547712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.560384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1356/2690] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:52 2022] PUT /identity/v3/projects/57a630ccd819476cb0e2dc30ad83a284/users/020827bc9e4d4e90ad8904fe447b9c0b/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:52.571745 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.572057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.572333 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.599500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] MFA Rules not processed for user `020827bc9e4d4e90ad8904fe447b9c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:52.600836 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:52.660938 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:52.664798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1335/2691] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:52.669356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.729562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66432f5-fc33-4e2c-8502-ebea8829e4b5 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.734099 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.734696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.734973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.735238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.735862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.737759 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.764467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1357/2692] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:52.768480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.779321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dfb6b-2e20-4ba0-86d9-87185daeaa50 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.838912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.839527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.839803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.840115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.840731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.842662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.864217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1336/2693] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:52.868309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.878394 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5d9b4-e28f-4f30-9201-8b3d807e7768 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.883348 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.883958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.884235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.884507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.885142 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.886727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.897619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1358/2694] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:52.901476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.911310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5dda7-8fa8-47d7-aa73-37a6769dda1d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.916096 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b21b79-6780-4609-a49c-a56e91dbc530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.916690 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b21b79-6780-4609-a49c-a56e91dbc530 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.916973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b21b79-6780-4609-a49c-a56e91dbc530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.917242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b21b79-6780-4609-a49c-a56e91dbc530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.917905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b21b79-6780-4609-a49c-a56e91dbc530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.919543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b21b79-6780-4609-a49c-a56e91dbc530 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.929377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1337/2695] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:52.933221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:52.942886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7e6e3-6758-4fc0-982b-f0fcda5dd9f3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:52.947895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:52.948547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.948826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.949098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] PATH_INFO: `/v3/projects/c5660e5442c1456d8b392e06ba9f0934/users/7371b985110b428ba38d43d593cf3aed/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:52.963475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5660e5442c1456d8b392e06ba9f0934, user_id=7371b985110b428ba38d43d593cf3aed, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:52.966126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:52.980082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1359/2696] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:52 2022] PUT /identity/v3/projects/c5660e5442c1456d8b392e06ba9f0934/users/7371b985110b428ba38d43d593cf3aed/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:23:52.991665 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:52.991968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:52.992278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.020400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] MFA Rules not processed for user `7371b985110b428ba38d43d593cf3aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:53.021610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:53.087082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1338/2697] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:53.091546 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.112159 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:53.157804 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4d61-888b-42b8-b03f-372bc06d586e admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.162950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.163558 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.163836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.164136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.164775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.166668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.193330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1360/2698] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:53 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:53.197539 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.208529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3f2f-f4d3-4831-9ab7-ff1b44b55293 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.265944 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.266483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.266763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.267055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.267712 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.269768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.286025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:53.293830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1339/2699] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:53 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:23:53.297770 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.309174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaac083-7f56-467e-bfc1-d971dce51e36 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.313948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.314573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.314854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.315126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.315765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.317388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.327844 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1361/2700] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:53.332176 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.342286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c762c-5be5-438b-b9f2-5da56f8195f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.346726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.347358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.347632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.347899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] PATH_INFO: `/v3/projects/232e72385b47481fba1ab388e19a6edd/users/bbbe7a1d732b4be182d21654c99bc730/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.362632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232e72385b47481fba1ab388e19a6edd, user_id=bbbe7a1d732b4be182d21654c99bc730, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.365292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.377542 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1340/2701] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:53 2022] PUT /identity/v3/projects/232e72385b47481fba1ab388e19a6edd/users/bbbe7a1d732b4be182d21654c99bc730/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:53.383239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.393143 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853756ff-02f5-4203-9bac-dfc171aabaad admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.449677 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aa11a-d754-40b9-b188-11845f2d721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.450275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aa11a-d754-40b9-b188-11845f2d721e admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.450561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aa11a-d754-40b9-b188-11845f2d721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.450834 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aa11a-d754-40b9-b188-11845f2d721e admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.451467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570aa11a-d754-40b9-b188-11845f2d721e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.453074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570aa11a-d754-40b9-b188-11845f2d721e admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.463162 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1362/2702] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:53.467269 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.477446 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec9e83-ceb4-4e3b-8c6e-61288c3d0d45 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.482194 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.482837 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.483110 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.483380 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] PATH_INFO: `/v3/projects/232e72385b47481fba1ab388e19a6edd/users/bbbe7a1d732b4be182d21654c99bc730/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.485305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=232e72385b47481fba1ab388e19a6edd, user_id=bbbe7a1d732b4be182d21654c99bc730, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.487909 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.498465 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1341/2703] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:53 2022] PUT /identity/v3/projects/232e72385b47481fba1ab388e19a6edd/users/bbbe7a1d732b4be182d21654c99bc730/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:53.510797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.511118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.511420 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.540791 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] MFA Rules not processed for user `bbbe7a1d732b4be182d21654c99bc730`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:53.541939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:53.609484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1363/2704] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:53.621161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.622927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:53.681388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d65b9-1b9f-48b4-aac0-94bbac4cf4bc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.685047 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.685687 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.685953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.686221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.694984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.696430 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.705477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1342/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:53.751748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:53.753155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:53.765223 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969a4c-6925-464e-92ea-f1fe807be282 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:53.768850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:53.769438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:53.769714 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:53.769982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:53.779136 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:53.827140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:53.828561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:53.838286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1364/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:54.574707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:54.576318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:54.633790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ed4cb-1e3a-4467-9cdc-375beb810cad service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:54.637340 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:54.637940 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:54.638213 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:54.638480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:54.640174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:54.649336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:54.650740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d638c4c-9b45-4138-9cc0-15aad7ace6d2 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:54.658613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1343/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:56.743258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:56.810176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9f1e3-0aa5-414e-b5d6-dfe0749ec622 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:56.814626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:56.815256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:56.815532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:56.815805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] PATH_INFO: `/v3/users/020827bc9e4d4e90ad8904fe447b9c0b` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:56.816966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=020827bc9e4d4e90ad8904fe447b9c0b)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:56.819404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:56.864237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020827bc9e4d4e90ad8904fe447b9c0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:56.864960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020827bc9e4d4e90ad8904fe447b9c0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:56.871743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020827bc9e4d4e90ad8904fe447b9c0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:56.872407 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020827bc9e4d4e90ad8904fe447b9c0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:56.881532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020827bc9e4d4e90ad8904fe447b9c0b'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:56.902641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1365/2708] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:56 2022] DELETE /identity/v3/users/020827bc9e4d4e90ad8904fe447b9c0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:56.907229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:56.907726 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:56.907826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:56.926692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:56.927880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:56.986425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1344/2709] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:56.996149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:56.997572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:57.035886 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:57.060684 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fba6-423f-4826-ad92-5e401e9fb7fa admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:57.064252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:57.064859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:57.065135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:57.065404 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:57.074680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:57.076138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:57.085384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1366/2710] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:23:57.365560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:57.366965 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:57.379970 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fa4b3-8e0d-4078-9196-fd857a64a7ed None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:57.385172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:57.385751 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:57.386028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:57.386298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] PATH_INFO: `/v3/projects/57a630ccd819476cb0e2dc30ad83a284` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:57.387418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a630ccd819476cb0e2dc30ad83a284)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:57.389410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:57.391757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:57.439627 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a630ccd819476cb0e2dc30ad83a284', 'request_id': 'req-ef9e2381-e027-48ef-90b8-0157a71c9591'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.445697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a630ccd819476cb0e2dc30ad83a284', 'request_id': 'req-ef9e2381-e027-48ef-90b8-0157a71c9591'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.453219 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a630ccd819476cb0e2dc30ad83a284', 'request_id': 'req-ef9e2381-e027-48ef-90b8-0157a71c9591'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.463573 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] The token cache is being invalidate because project 57a630ccd819476cb0e2dc30ad83a284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:57.463862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.464504 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.465975 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1345/2711] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:57 2022] DELETE /identity/v3/projects/57a630ccd819476cb0e2dc30ad83a284 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:57.469951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:57.479912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204d8a-c078-4762-8226-95918d478958 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:57.534923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:57.535554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:57.535832 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:57.536138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] PATH_INFO: `/v3/users/7371b985110b428ba38d43d593cf3aed` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:57.537764 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7371b985110b428ba38d43d593cf3aed)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:57.539685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:57.584007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7371b985110b428ba38d43d593cf3aed'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.584755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7371b985110b428ba38d43d593cf3aed'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.591654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7371b985110b428ba38d43d593cf3aed'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.592294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7371b985110b428ba38d43d593cf3aed'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.599232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7371b985110b428ba38d43d593cf3aed'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:57.617118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1367/2712] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:57 2022] DELETE /identity/v3/users/7371b985110b428ba38d43d593cf3aed => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:57.900565 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:57.902175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:57.917236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2381-e027-48ef-90b8-0157a71c9591 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:57.978812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:57.979461 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:57.979740 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:57.980050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] PATH_INFO: `/v3/projects/c5660e5442c1456d8b392e06ba9f0934` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:57.981183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5660e5442c1456d8b392e06ba9f0934)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:57.983089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:58.028910 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5660e5442c1456d8b392e06ba9f0934', 'request_id': 'req-c10bb23c-f1c6-4276-a580-87fdee62bbf7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.035026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5660e5442c1456d8b392e06ba9f0934', 'request_id': 'req-c10bb23c-f1c6-4276-a580-87fdee62bbf7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.042312 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5660e5442c1456d8b392e06ba9f0934', 'request_id': 'req-c10bb23c-f1c6-4276-a580-87fdee62bbf7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.053061 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] The token cache is being invalidate because project c5660e5442c1456d8b392e06ba9f0934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:58.053348 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.053971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.055438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1346/2713] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:57 2022] DELETE /identity/v3/projects/c5660e5442c1456d8b392e06ba9f0934 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:58.059448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:58.060851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:58.073908 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379c987-caee-46eb-9ebb-2084b2235ab7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:58.120181 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:58.131213 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:58.131837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:58.132238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:58.132508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] PATH_INFO: `/v3/users/bbbe7a1d732b4be182d21654c99bc730` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:58.133660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbe7a1d732b4be182d21654c99bc730)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:58.135852 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:58.180826 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbe7a1d732b4be182d21654c99bc730'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.181457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbe7a1d732b4be182d21654c99bc730'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.188161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbe7a1d732b4be182d21654c99bc730'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.188775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbe7a1d732b4be182d21654c99bc730'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.195788 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-06f314a0-acfe-42ed-b911-a2fed708f320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbe7a1d732b4be182d21654c99bc730'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.212634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1368/2714] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:23:58 2022] DELETE /identity/v3/users/bbbe7a1d732b4be182d21654c99bc730 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:58.744393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:58.746215 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:58.762600 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bb23c-f1c6-4276-a580-87fdee62bbf7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:58.781161 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:58.822848 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:58.823496 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:58.823819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:58.824130 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] PATH_INFO: `/v3/projects/232e72385b47481fba1ab388e19a6edd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:58.825265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232e72385b47481fba1ab388e19a6edd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:58.827168 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:58.872960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232e72385b47481fba1ab388e19a6edd', 'request_id': 'req-fec89395-f1d5-4acc-a682-a0e063f74669'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.879184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232e72385b47481fba1ab388e19a6edd', 'request_id': 'req-fec89395-f1d5-4acc-a682-a0e063f74669'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.886392 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232e72385b47481fba1ab388e19a6edd', 'request_id': 'req-fec89395-f1d5-4acc-a682-a0e063f74669'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.897266 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] The token cache is being invalidate because project 232e72385b47481fba1ab388e19a6edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:23:58.897575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.898193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-fec89395-f1d5-4acc-a682-a0e063f74669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:23:58.899646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1347/2715] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:23:58 2022] DELETE /identity/v3/projects/232e72385b47481fba1ab388e19a6edd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:58.905433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:58.905722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:58.906040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:58.925395 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:58.926588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:58.987880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1369/2716] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:58.996178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de289-e921-4283-b72a-b38817284843 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:58.996727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de289-e921-4283-b72a-b38817284843 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:58.996727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de289-e921-4283-b72a-b38817284843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.017407 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8a7de289-e921-4283-b72a-b38817284843 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:59.018731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8a7de289-e921-4283-b72a-b38817284843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:59.027771 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1348/2717] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:59.032056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.041570 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b696446-de0e-4a89-8c6e-ab538bc63507 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.046230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.046837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.050343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.050653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.051334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:23:59.051640 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.053263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.065085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1370/2718] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:23:59.069811 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de289-e921-4283-b72a-b38817284843 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.079156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de289-e921-4283-b72a-b38817284843 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.084588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.085183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.085459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.085731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.086355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.088275 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.114289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1349/2719] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:23:59 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:59.118350 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.127959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab26676-f48c-4442-9b5c-8a82299d7074 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.182999 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.183604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.183895 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.184188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.184822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.186737 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.195133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:59.211042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1371/2720] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:23:59 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:23:59.215020 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.225166 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78128-7c65-4a89-a70a-b45ce2d07575 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.229692 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.230289 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.230569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.230840 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.231477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.233118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.243265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1350/2721] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:59.246837 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.257817 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0b185-bd07-44c9-a04b-ff8b7c998def admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.262476 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bf49-10ff-49c8-9fe7-db913aa41712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.263068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bf49-10ff-49c8-9fe7-db913aa41712 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.263343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bf49-10ff-49c8-9fe7-db913aa41712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.263612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bf49-10ff-49c8-9fe7-db913aa41712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.264358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bf49-10ff-49c8-9fe7-db913aa41712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.266423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bf49-10ff-49c8-9fe7-db913aa41712 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.278001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1372/2722] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:23:59.282169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.292568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469179-214e-4422-a5db-24705ab5af60 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.297355 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.298021 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.298295 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.298588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] PATH_INFO: `/v3/projects/56f1a247a54f4880909d0c4efcac8ff8/users/c1f933fb11e243e9bbb28a1799b7f5fd/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.314667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f1a247a54f4880909d0c4efcac8ff8, user_id=c1f933fb11e243e9bbb28a1799b7f5fd, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.317331 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.330396 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1351/2723] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:23:59 2022] PUT /identity/v3/projects/56f1a247a54f4880909d0c4efcac8ff8/users/c1f933fb11e243e9bbb28a1799b7f5fd/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:23:59.341574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8d82-aefa-435d-b85d-29abec4c51ab None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.341859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8d82-aefa-435d-b85d-29abec4c51ab None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.342129 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f8d82-aefa-435d-b85d-29abec4c51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.369190 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f44f8d82-aefa-435d-b85d-29abec4c51ab None None] MFA Rules not processed for user `c1f933fb11e243e9bbb28a1799b7f5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:23:59.370378 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f44f8d82-aefa-435d-b85d-29abec4c51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:59.432433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1373/2724] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:23:59.444641 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:23:59.446318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:23:59.496968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:59.503237 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a1f3-6ccd-483d-81eb-71bb86a2328f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:23:59.508334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:23:59.508934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:23:59.509204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:23:59.509468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:23:59.517510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:23:59.518907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:23:59.527515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1352/2725] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:23:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:24:06.399527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:06.400014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:06.400110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:06.419789 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:06.421334 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:06.478772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1374/2726] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:06.533053 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:06.534478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:06.603501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf3a51-2263-4db4-840d-ef1cdf22c5a8 service glance] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:06.608290 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:06.608893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:06.609164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:06.609432 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:06.617777 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:06.619414 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:06.629106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1353/2727] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:06.984208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:06.987117 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:07.097258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d433e-afd2-4209-9094-d480c76d8a42 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:07.105097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:07.107144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:07.107703 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:07.108220 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:07.110278 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:07.124042 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:07.127968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e4ba9-20c6-4b6b-a770-f8b9cff01417 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:07.135822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:07.145088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1375/2728] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:07.166659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:07.168197 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:07.193952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479abf6-c817-4686-8747-b973d7074201 service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:07.200040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:07.200761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:07.201159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:07.201530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:07.203376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:07.285562 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:07.303977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512bf17-fa2b-4ed2-aae4-c962797edd10 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:07.318720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1354/2729] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:17.150823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:17.311456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=65 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:20.399038 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8d80-0568-4a8b-ba27-1868c7ca22b2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.399575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8d80-0568-4a8b-ba27-1868c7ca22b2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.399673 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8d80-0568-4a8b-ba27-1868c7ca22b2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.401230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1376/2730] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:24:20.406830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79f56-e3d3-4d07-98fd-b487396345b6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.407393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79f56-e3d3-4d07-98fd-b487396345b6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.407513 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c79f56-e3d3-4d07-98fd-b487396345b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.428517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b6c79f56-e3d3-4d07-98fd-b487396345b6 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:20.429724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b6c79f56-e3d3-4d07-98fd-b487396345b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:20.439447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1355/2731] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:20.453055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df8d80-0568-4a8b-ba27-1868c7ca22b2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:20.455058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-79df8d80-0568-4a8b-ba27-1868c7ca22b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:20.474272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df8d80-0568-4a8b-ba27-1868c7ca22b2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:20.480090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f3ae0-3658-4b73-9211-8b6042b3f523 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:20.480701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f3ae0-3658-4b73-9211-8b6042b3f523 service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.481039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f3ae0-3658-4b73-9211-8b6042b3f523 service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.481258 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f3ae0-3658-4b73-9211-8b6042b3f523 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.493323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f3ae0-3658-4b73-9211-8b6042b3f523 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:20.495578 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f3ae0-3658-4b73-9211-8b6042b3f523 service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:20.515653 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1377/2732] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:20.584293 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d1a26-b09a-4793-96bb-9aa90e56aae4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.584593 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d1a26-b09a-4793-96bb-9aa90e56aae4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.584861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d1a26-b09a-4793-96bb-9aa90e56aae4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.586203 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1356/2733] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:24:20.590848 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a20e-b08d-48f3-bb39-ed1abea1744f None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.591135 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a20e-b08d-48f3-bb39-ed1abea1744f None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.591411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a20e-b08d-48f3-bb39-ed1abea1744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.610544 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-55f3a20e-b08d-48f3-bb39-ed1abea1744f None None] MFA Rules not processed for user `07cf20962b404013898ef0d093cf53ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:20.611735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-55f3a20e-b08d-48f3-bb39-ed1abea1744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:20.663025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1378/2734] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:24:20.675381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d1a26-b09a-4793-96bb-9aa90e56aae4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:20.677607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-056d1a26-b09a-4793-96bb-9aa90e56aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:20.691619 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d1a26-b09a-4793-96bb-9aa90e56aae4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:20.695274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a041-648e-4152-a2ef-ff17be3907b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:20.695875 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a041-648e-4152-a2ef-ff17be3907b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.696178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a041-648e-4152-a2ef-ff17be3907b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.696443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a041-648e-4152-a2ef-ff17be3907b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.703790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1a041-648e-4152-a2ef-ff17be3907b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:20.705238 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1a041-648e-4152-a2ef-ff17be3907b0 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:20.712903 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1357/2735] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:20.806686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a4d5-50e8-44cd-9c22-cae27b0b528a None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.806976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a4d5-50e8-44cd-9c22-cae27b0b528a None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.807252 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a4d5-50e8-44cd-9c22-cae27b0b528a None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.808623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1379/2736] 10.222.0.27 () {54 vars in 921 bytes} [Sat Oct 1 04:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:24:20.815342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.815623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.815896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.836228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] MFA Rules not processed for user `424b048ef3454b8597a80c0f605b4c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:20.837134 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:20.847066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1358/2737] 10.222.0.27 () {58 vars in 1018 bytes} [Sat Oct 1 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:24:20.859626 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514a4d5-50e8-44cd-9c22-cae27b0b528a None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:20.861792 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c514a4d5-50e8-44cd-9c22-cae27b0b528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:20.875833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514a4d5-50e8-44cd-9c22-cae27b0b528a None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:20.879709 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:20.880345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:20.880625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:20.880894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:20.891145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:20.892611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:20.903311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1380/2738] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:20.973720 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:20.975150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:21.046326 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e36f5-e931-45f0-91f6-96f51cf16856 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:21.052028 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:21.052645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:21.052941 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:21.053211 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:21.054985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:21.066636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:21.068443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d9f29-9bb4-41a7-9992-57341557776f service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:21.079010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1359/2739] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:21.600165 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:21.674436 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9388-e363-43bf-8b02-e77b50053098 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:21.679215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:21.679846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:21.680152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:21.680427 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] PATH_INFO: `/v3/users/c1f933fb11e243e9bbb28a1799b7f5fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:21.681526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f933fb11e243e9bbb28a1799b7f5fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:21.683661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:21.733517 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f933fb11e243e9bbb28a1799b7f5fd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:21.734163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f933fb11e243e9bbb28a1799b7f5fd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:21.741568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f933fb11e243e9bbb28a1799b7f5fd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:21.742189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f933fb11e243e9bbb28a1799b7f5fd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:21.749411 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f933fb11e243e9bbb28a1799b7f5fd'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:21.766543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1381/2740] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:24:21 2022] DELETE /identity/v3/users/c1f933fb11e243e9bbb28a1799b7f5fd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:21.770981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:21.771473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:21.771585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:21.790344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:21.791525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:21.849569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1360/2741] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:24:21.859362 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:21.860964 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:21.866823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:21.921579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200000d-8640-4ab8-8881-c365aca9d236 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:21.925251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca249-893c-42e3-8367-9c100086b836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:21.925861 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca249-893c-42e3-8367-9c100086b836 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:21.926723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca249-893c-42e3-8367-9c100086b836 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:21.927004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca249-893c-42e3-8367-9c100086b836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:21.936502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bca249-893c-42e3-8367-9c100086b836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:21.937935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bca249-893c-42e3-8367-9c100086b836 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:21.947825 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1382/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:22.216569 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.218056 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.232366 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c418805-d85f-4970-9c3a-08868f9e64f5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.237099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.238044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.238405 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.239330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] PATH_INFO: `/v3/projects/56f1a247a54f4880909d0c4efcac8ff8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.240613 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f1a247a54f4880909d0c4efcac8ff8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.242581 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.292917 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f1a247a54f4880909d0c4efcac8ff8', 'request_id': 'req-20fe5410-a82b-4219-b7f4-d74f5298279c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:22.298872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f1a247a54f4880909d0c4efcac8ff8', 'request_id': 'req-20fe5410-a82b-4219-b7f4-d74f5298279c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:22.302964 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:22.307174 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f1a247a54f4880909d0c4efcac8ff8', 'request_id': 'req-20fe5410-a82b-4219-b7f4-d74f5298279c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:22.320477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] The token cache is being invalidate because project 56f1a247a54f4880909d0c4efcac8ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:24:22.320846 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:22.321477 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-20fe5410-a82b-4219-b7f4-d74f5298279c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:22.324005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1361/2743] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:24:22 2022] DELETE /identity/v3/projects/56f1a247a54f4880909d0c4efcac8ff8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:22.328785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.329094 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.329371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.349573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:22.350713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.414634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1383/2744] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:24:22.423425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.423737 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.424041 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.444882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:22.446113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.454244 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1362/2745] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:22.458576 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.468535 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bc366-7207-4157-af88-f81c0e598261 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.474233 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.474899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.475232 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.475598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.476356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:24:22.476735 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.478260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.490301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1384/2746] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:24:22.494651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.504719 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f318d0-6e6c-453d-ae38-06761538c6a2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.509353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e951f71-9427-46b7-921a-6fa0dfcfea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.509953 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e951f71-9427-46b7-921a-6fa0dfcfea7b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.510229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e951f71-9427-46b7-921a-6fa0dfcfea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.510499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e951f71-9427-46b7-921a-6fa0dfcfea7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.511123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e951f71-9427-46b7-921a-6fa0dfcfea7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.513051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e951f71-9427-46b7-921a-6fa0dfcfea7b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.539682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1363/2747] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:24:22 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:24:22.544237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.554526 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0349f3f-2293-4a05-9436-d6008d207730 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.612080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.612773 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.613051 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.613319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.614529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.616471 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.616921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.617268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.617601 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.642352 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1385/2748] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:24:22 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:24:22.642558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:22.642558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.643854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.653668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243da9-23d8-4776-8a41-4b2428d570dc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.658183 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.658757 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.659033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.659299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.659928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.661604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.672537 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1386/2749] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:24:22.676697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.685939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575ca45-f3b3-49c3-bf32-72166c874d5b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.690618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.691341 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.691793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.692098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.692729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.694528 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.696148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1364/2750] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:24:22.699740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:22.705276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1387/2751] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:24:22.709486 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.709654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.710882 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.719468 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0f480-0508-4c98-97ec-4c8e2398e640 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.724319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ed58-42a6-4a3d-8d5b-d2231295177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.724951 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ed58-42a6-4a3d-8d5b-d2231295177f admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.725229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ed58-42a6-4a3d-8d5b-d2231295177f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.725496 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ed58-42a6-4a3d-8d5b-d2231295177f admin admin] PATH_INFO: `/v3/projects/c5917e0903814bf7a64a949c5510a7ca/users/7271fbd63dd946c89af219a3a9547752/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.740830 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ed58-42a6-4a3d-8d5b-d2231295177f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5917e0903814bf7a64a949c5510a7ca, user_id=7271fbd63dd946c89af219a3a9547752, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.743696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ed58-42a6-4a3d-8d5b-d2231295177f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.768620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1388/2752] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:24:22 2022] PUT /identity/v3/projects/c5917e0903814bf7a64a949c5510a7ca/users/7271fbd63dd946c89af219a3a9547752/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:22.770863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.771148 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.771469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.791497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af74d7-147f-4a10-b4c5-c6bad36252cf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.802255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] MFA Rules not processed for user `7271fbd63dd946c89af219a3a9547752`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:22.803451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.882995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1389/2753] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:22.883957 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7c55-36cd-46d9-80d8-404031cf8e9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.884727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7c55-36cd-46d9-80d8-404031cf8e9d service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.885073 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7c55-36cd-46d9-80d8-404031cf8e9d service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.885441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7c55-36cd-46d9-80d8-404031cf8e9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.892451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:22.895572 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:22.897118 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:22.958683 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f84b-d3d3-4b52-b64e-a88256060228 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:22.959103 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7c55-36cd-46d9-80d8-404031cf8e9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.960761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7c55-36cd-46d9-80d8-404031cf8e9d service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.962410 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb76d6-e6f8-4360-9e59-a7a76d1acb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:22.963016 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb76d6-e6f8-4360-9e59-a7a76d1acb39 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:22.963289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb76d6-e6f8-4360-9e59-a7a76d1acb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:22.963551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb76d6-e6f8-4360-9e59-a7a76d1acb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:22.969210 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1365/2754] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 01 04:24:22.972551 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb76d6-e6f8-4360-9e59-a7a76d1acb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:22.974105 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb76d6-e6f8-4360-9e59-a7a76d1acb39 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:22.983457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1390/2755] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:24.460409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:24.460981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:24.460981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:24.481080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] MFA Rules not processed for user `7271fbd63dd946c89af219a3a9547752`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:24.482284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:24.491971 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1366/2756] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:32.978980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:34.475306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=27 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:36.412939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50c1b-d954-456e-a4df-44fef6d213d4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:36.413405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50c1b-d954-456e-a4df-44fef6d213d4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:36.413502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50c1b-d954-456e-a4df-44fef6d213d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:36.432833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-3ad50c1b-d954-456e-a4df-44fef6d213d4 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:36.434015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3ad50c1b-d954-456e-a4df-44fef6d213d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:36.441004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1391/2757] 10.222.0.27 () {58 vars in 967 bytes} [Sat Oct 1 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:36.453195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:36.465014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e8eaf-c94e-4b19-8a10-2f7955c7e8e6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:36.470042 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:36.470670 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:36.470946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:36.471216 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:36.479804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:36.481404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:36.489931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1367/2758] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:43.721198 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb331eaa-fbd2-4f6c-890a-61ef764a7963 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:43.721682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb331eaa-fbd2-4f6c-890a-61ef764a7963 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:43.721781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb331eaa-fbd2-4f6c-890a-61ef764a7963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:43.741138 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-fb331eaa-fbd2-4f6c-890a-61ef764a7963 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:43.742267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-fb331eaa-fbd2-4f6c-890a-61ef764a7963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:43.749299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1392/2759] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:43.762382 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:43.772798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad5ac2-8bf3-4438-925a-fd2e56efa13c service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:43.777752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:43.778344 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:43.778625 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:43.778896 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:43.786826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:43.788422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:43.796713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1368/2760] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:44.305620 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867abe-8ba1-4970-b93d-b0263a935dd4 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:44.305902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867abe-8ba1-4970-b93d-b0263a935dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:44.306176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867abe-8ba1-4970-b93d-b0263a935dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:44.325269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f8867abe-8ba1-4970-b93d-b0263a935dd4 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:44.326473 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f8867abe-8ba1-4970-b93d-b0263a935dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:44.334008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1393/2761] 10.222.0.27 () {58 vars in 967 bytes} [Sat Oct 1 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:44.345888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:44.356805 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92283ed-c11f-4e33-84f2-8301af6cb386 service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:44.361637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:44.362217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:44.362487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:44.362749 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:44.370460 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:44.372055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:44.380034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1369/2762] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:44.600655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3d4d-2762-4fe1-81ee-9fdeb67a0b44 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:44.600936 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3d4d-2762-4fe1-81ee-9fdeb67a0b44 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:44.601207 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f3d4d-2762-4fe1-81ee-9fdeb67a0b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:44.620211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-992f3d4d-2762-4fe1-81ee-9fdeb67a0b44 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:44.621399 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-992f3d4d-2762-4fe1-81ee-9fdeb67a0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:44.633320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1394/2763] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:44.645336 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:44.656904 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909979-d773-4b3a-b898-6994a9549b5a service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:44.661894 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:44.662487 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:44.662762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:44.663032 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:44.670853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:44.672447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:44.680635 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1370/2764] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:44.996267 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:44.996754 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:44.996857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:45.015793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:45.017014 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:45.024531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1395/2765] 10.222.0.27 () {58 vars in 967 bytes} [Sat Oct 1 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:45.037185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:45.047472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb841e-018d-4793-be1b-1a8ec439694b service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:45.052327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d487b-8127-4e5d-bb7d-0ce8bd252afa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:45.052908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d487b-8127-4e5d-bb7d-0ce8bd252afa service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:45.053179 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d487b-8127-4e5d-bb7d-0ce8bd252afa service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:45.053443 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d487b-8127-4e5d-bb7d-0ce8bd252afa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:45.061112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d487b-8127-4e5d-bb7d-0ce8bd252afa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:45.062651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d487b-8127-4e5d-bb7d-0ce8bd252afa service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:45.070387 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1371/2766] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:47.132215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:47.192634 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c3323-7334-4aea-9c25-4f1d0c0cfa97 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:47.197056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:47.197674 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.197947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.198212 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] PATH_INFO: `/v3/users/7271fbd63dd946c89af219a3a9547752` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.199318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7271fbd63dd946c89af219a3a9547752)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:47.201230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:47.245660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7271fbd63dd946c89af219a3a9547752'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.246302 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7271fbd63dd946c89af219a3a9547752'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.253327 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7271fbd63dd946c89af219a3a9547752'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.253949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7271fbd63dd946c89af219a3a9547752'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.262300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7271fbd63dd946c89af219a3a9547752'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.279582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1396/2767] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:24:47 2022] DELETE /identity/v3/users/7271fbd63dd946c89af219a3a9547752 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:47.284182 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.284649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.284768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.303960 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:47.305159 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:47.362051 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1372/2768] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:47.372211 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:47.373600 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:47.425650 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:47.432548 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c353b7-ab92-4c31-ac8d-4d0c62dfab40 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:47.437244 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a4d3c-a8ce-4ee4-a439-cfbb3c0a576e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:47.437846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a4d3c-a8ce-4ee4-a439-cfbb3c0a576e service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.438121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a4d3c-a8ce-4ee4-a439-cfbb3c0a576e service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.438392 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a4d3c-a8ce-4ee4-a439-cfbb3c0a576e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.447782 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a4d3c-a8ce-4ee4-a439-cfbb3c0a576e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:47.449217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a4d3c-a8ce-4ee4-a439-cfbb3c0a576e service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:47.458928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1397/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:47.617858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:47.619404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:47.633097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3dc6-01cc-43db-8a6b-8f23f07f3e6c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:47.637934 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:47.638558 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.638879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.639093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] PATH_INFO: `/v3/projects/c5917e0903814bf7a64a949c5510a7ca` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.640345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5917e0903814bf7a64a949c5510a7ca)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:47.642231 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:47.690175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5917e0903814bf7a64a949c5510a7ca', 'request_id': 'req-819fda99-efbe-4279-a251-3d6b08721d56'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.696579 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5917e0903814bf7a64a949c5510a7ca', 'request_id': 'req-819fda99-efbe-4279-a251-3d6b08721d56'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.703697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5917e0903814bf7a64a949c5510a7ca', 'request_id': 'req-819fda99-efbe-4279-a251-3d6b08721d56'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.714223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] The token cache is being invalidate because project c5917e0903814bf7a64a949c5510a7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:24:47.714510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.715155 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-819fda99-efbe-4279-a251-3d6b08721d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:24:47.716667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1373/2770] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:24:47 2022] DELETE /identity/v3/projects/c5917e0903814bf7a64a949c5510a7ca => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:47.722814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.723647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.723958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.743524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:47.744751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:47.804025 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1398/2771] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:47.812271 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.812765 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.814196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.834321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:47.835517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:47.843360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1374/2772] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:47.847607 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:47.857691 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72c5c8-2f9f-49e3-ac83-c108e2851871 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:47.862112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:47.862778 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.863017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.863269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.864559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:24:47.864859 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:47.866445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:47.878033 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1399/2773] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:24:47.882141 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:47.891120 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52826a-a523-4bb9-b1ad-5cbe8392d049 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:47.895647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:47.896281 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.896552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.896819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:47.897447 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:47.899349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:47.908968 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:47.929249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1375/2774] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:24:47 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:24:47.933342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:47.943066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511018-807a-4d86-b20c-e0f29154198a admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:47.998624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:47.999261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:47.999682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:47.999966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:48.000613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:48.002520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:48.023108 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1400/2775] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:24:47 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:24:48.027321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:48.037620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aff76f-469a-46d4-b22c-b8c50a5a722b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:48.042272 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:48.042888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:48.043192 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:48.043494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:48.044226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:48.045900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:48.056221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1376/2776] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:24:48.059896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:48.070303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6a032-15a0-4114-abbb-54c49a406a65 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:48.074744 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a31cc-e31a-4b37-bb08-ffa71fb91edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:48.075320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a31cc-e31a-4b37-bb08-ffa71fb91edd admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:48.075595 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a31cc-e31a-4b37-bb08-ffa71fb91edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:48.075863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a31cc-e31a-4b37-bb08-ffa71fb91edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:48.076536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a31cc-e31a-4b37-bb08-ffa71fb91edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:48.078091 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a31cc-e31a-4b37-bb08-ffa71fb91edd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:48.088246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1401/2777] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:24:48.092080 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:48.101976 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae94ac6-c1a0-4a0e-8f38-34df4539427b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:48.106457 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:48.107090 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:48.107363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:48.107630 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] PATH_INFO: `/v3/projects/8e1d95b13899491e8489b0871cec35aa/users/6c9bf0b1ae694dbe95df018449d35b32/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:48.122191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1d95b13899491e8489b0871cec35aa, user_id=6c9bf0b1ae694dbe95df018449d35b32, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:48.124921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:48.138127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1377/2778] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:24:48 2022] PUT /identity/v3/projects/8e1d95b13899491e8489b0871cec35aa/users/6c9bf0b1ae694dbe95df018449d35b32/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:48.143178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28290710-fb42-4e0c-81ec-773e78c10b05 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:48.143665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28290710-fb42-4e0c-81ec-773e78c10b05 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:48.143780 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28290710-fb42-4e0c-81ec-773e78c10b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:48.162260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-28290710-fb42-4e0c-81ec-773e78c10b05 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:48.163461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-28290710-fb42-4e0c-81ec-773e78c10b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:48.210840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:48.223189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1402/2779] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:48.232872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:48.234590 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:48.291585 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4111-a1c3-4c35-ba24-6d5b1880530d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:48.295241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:48.295838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:48.296140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:48.296409 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:48.305689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:48.307099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:48.316265 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1378/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:24:52.486519 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.487063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.487063 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.516316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] MFA Rules not processed for user `6c9bf0b1ae694dbe95df018449d35b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:52.517562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:52.584577 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1403/2781] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:52.589286 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:52.599372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f04d0-b13c-4ae8-b874-5ca3660e6cc2 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:52.603878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:52.604515 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.604795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.605066 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.605705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:52.607609 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:52.638952 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1379/2782] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:24:52 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:24:52.643262 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:52.654948 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534ad03-f325-4042-9776-85fc389bf079 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:52.711896 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:52.712563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.712840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.713111 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.713742 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:52.715708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:52.736667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1404/2783] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:24:52 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:24:52.740921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:52.751318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd82b9-31fb-428a-8623-c717aff629a6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:52.756825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:52.757425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.757703 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.758004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.758662 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:52.760303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:52.770932 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1380/2784] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:24:52.775030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:52.784835 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ebd7b-8eb8-4d7c-ba6a-282f8a28df83 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:52.789504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:52.790146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.790424 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.790695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] PATH_INFO: `/v3/projects/b0136dd3d1c144e0b1682729b79f15f2/users/404476b4d1c34226b7bf980b8bb846ea/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.805767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0136dd3d1c144e0b1682729b79f15f2, user_id=404476b4d1c34226b7bf980b8bb846ea, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:52.808747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:52.821591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1405/2785] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:24:52 2022] PUT /identity/v3/projects/b0136dd3d1c144e0b1682729b79f15f2/users/404476b4d1c34226b7bf980b8bb846ea/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:52.828343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:52.836744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958443db-30d4-4de1-9b62-be01cb16a037 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:52.894319 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91806c-b225-4afb-8ea8-285ea1586281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:52.895550 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91806c-b225-4afb-8ea8-285ea1586281 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.895824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91806c-b225-4afb-8ea8-285ea1586281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.896152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91806c-b225-4afb-8ea8-285ea1586281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.896763 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91806c-b225-4afb-8ea8-285ea1586281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:52.898490 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91806c-b225-4afb-8ea8-285ea1586281 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:52.908278 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1381/2786] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:24:52.912711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:52.922856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59a16-db78-4b56-a221-6fe7afecb028 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:52.927405 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:52.928069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:52.928344 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:52.928777 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] PATH_INFO: `/v3/projects/b0136dd3d1c144e0b1682729b79f15f2/users/404476b4d1c34226b7bf980b8bb846ea/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:52.930772 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0136dd3d1c144e0b1682729b79f15f2, user_id=404476b4d1c34226b7bf980b8bb846ea, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:52.933416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:52.944015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1406/2787] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:24:52 2022] PUT /identity/v3/projects/b0136dd3d1c144e0b1682729b79f15f2/users/404476b4d1c34226b7bf980b8bb846ea/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:24:57.856342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcbc3f-703b-4bf3-bee7-4702fd733b5d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:57.856825 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcbc3f-703b-4bf3-bee7-4702fd733b5d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:57.856921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcbc3f-703b-4bf3-bee7-4702fd733b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:57.887533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78fcbc3f-703b-4bf3-bee7-4702fd733b5d None None] MFA Rules not processed for user `404476b4d1c34226b7bf980b8bb846ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:57.889602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78fcbc3f-703b-4bf3-bee7-4702fd733b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:57.899358 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:57.963671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1382/2788] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:24:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:24:57.977437 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:57.979625 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:58.022851 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:58.039659 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf70eb-78fc-4d9f-b56f-b324c23f4188 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:58.043310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1afa3489655343c699a658472da4646b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:58.043917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:58.044222 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:58.044494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:58.101654 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:58.103081 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:58.112328 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1407/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:24:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:24:58.249530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14d3e-5503-414d-af7a-bfd0f294aeee None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:58.249812 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14d3e-5503-414d-af7a-bfd0f294aeee None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:58.250089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e14d3e-5503-414d-af7a-bfd0f294aeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:58.270342 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a8e14d3e-5503-414d-af7a-bfd0f294aeee None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:24:58.271529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a8e14d3e-5503-414d-af7a-bfd0f294aeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:58.324284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1383/2790] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:24:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:24:58.336995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:24:58.338371 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:24:58.407961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3df79-b731-4aba-88c6-a736320c6399 service glance] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:24:58.412967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:24:58.413574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:24:58.413856 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:24:58.414127 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:24:58.422101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:24:58.423680 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:24:58.431641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1408/2791] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:25:07.173365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac444c1b-9781-4f2f-8449-01b3116caf16 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:07.173897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac444c1b-9781-4f2f-8449-01b3116caf16 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:07.174007 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac444c1b-9781-4f2f-8449-01b3116caf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:07.193109 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ac444c1b-9781-4f2f-8449-01b3116caf16 None None] MFA Rules not processed for user `6c9bf0b1ae694dbe95df018449d35b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:07.194284 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ac444c1b-9781-4f2f-8449-01b3116caf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:07.201067 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1384/2792] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:25:07.459624 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:07.516140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b4346-13c3-476d-a82d-d29a73fb5024 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:07.520398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:07.520995 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:07.521269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:07.521536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:07.523251 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:07.532565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:07.533963 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:07.541730 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1409/2793] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:09.069893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:09.070500 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:09.070636 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:09.090899 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:09.092149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:09.099378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1385/2794] 10.222.0.27 () {58 vars in 1009 bytes} [Sat Oct 1 04:25:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:25:09.111950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:09.125034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6dbc-f07f-4746-82ee-a6eff9098db1 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:09.130375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522154b-502a-4317-86f9-99a9daa25a8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:09.130982 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522154b-502a-4317-86f9-99a9daa25a8e service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:09.131260 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522154b-502a-4317-86f9-99a9daa25a8e service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:09.131529 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522154b-502a-4317-86f9-99a9daa25a8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:09.139675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522154b-502a-4317-86f9-99a9daa25a8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:09.141270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522154b-502a-4317-86f9-99a9daa25a8e service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:09.149985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1410/2795] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:25:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:25:19.085464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=56 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:19.148153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=95 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:24.029707 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:24.039195 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d26ebf-9a10-4b5a-878d-8c2b6b7c343e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:24.042727 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:24.043321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:24.043620 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:24.043885 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:24.045667 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:24.107280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:24.108657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88785d77-0594-4560-ab1d-ba7bdbe7b559 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:24.118563 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1386/2796] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:27.439166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab817d-c29d-48f6-be6b-efc8c62277c2 None None] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:27.440416 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab817d-c29d-48f6-be6b-efc8c62277c2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:27.440946 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab817d-c29d-48f6-be6b-efc8c62277c2 None None] PATH_INFO: `/` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:27.442611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1411/2797] 10.222.0.27 () {54 vars in 961 bytes} [Sat Oct 1 04:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 01 04:25:27.448362 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:27.448919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:27.449280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:27.469927 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] MFA Rules not processed for user `8c396bae46a64f1b8ca950fb8d7a2770`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:27.471826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:27.504300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab817d-c29d-48f6-be6b-efc8c62277c2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:27.507711 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-deab817d-c29d-48f6-be6b-efc8c62277c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:27.532605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab817d-c29d-48f6-be6b-efc8c62277c2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:27.538342 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:27.539102 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:27.539444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:27.539722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] PATH_INFO: `/v3/users/6b206c654b8f402785a06c31dd36ca40` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:27.541174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b206c654b8f402785a06c31dd36ca40)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:27.543132 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:27.555523 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1387/2798] 10.222.0.27 () {58 vars in 1058 bytes} [Sat Oct 1 04:25:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:25:27.565394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:27.576830 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1404-ccfd-4cb2-ae07-abcfd53ba86f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:27.582853 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:27.583716 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:27.584040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:27.584694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:27.587321 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:27.601391 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:27.602972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:27.613055 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1388/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:27.613318 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b206c654b8f402785a06c31dd36ca40'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.614153 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b206c654b8f402785a06c31dd36ca40'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.621967 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b206c654b8f402785a06c31dd36ca40'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.622619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b206c654b8f402785a06c31dd36ca40'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.631854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-9f786a37-2ce1-49da-8f78-40b361176e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b206c654b8f402785a06c31dd36ca40'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.653152 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1412/2800] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:25:27 2022] DELETE /identity/v3/users/6b206c654b8f402785a06c31dd36ca40 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:25:27.829071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:27.843394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66898480-c8c8-494e-879e-9d3be6085089 service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:27.902757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:27.903315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:27.903591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:27.903862 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] PATH_INFO: `/v3/projects/56427aed2fb54aaa89d904d7b50734c4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:27.905004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56427aed2fb54aaa89d904d7b50734c4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:27.906893 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:27.927568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:27.952695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56427aed2fb54aaa89d904d7b50734c4', 'request_id': 'req-c703f622-074a-426b-8fab-631f8b969712'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.958699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56427aed2fb54aaa89d904d7b50734c4', 'request_id': 'req-c703f622-074a-426b-8fab-631f8b969712'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.966715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56427aed2fb54aaa89d904d7b50734c4', 'request_id': 'req-c703f622-074a-426b-8fab-631f8b969712'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.976972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] The token cache is being invalidate because project 56427aed2fb54aaa89d904d7b50734c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:25:27.977255 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.977878 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c703f622-074a-426b-8fab-631f8b969712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:25:27.979324 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1389/2801] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:25:27 2022] DELETE /identity/v3/projects/56427aed2fb54aaa89d904d7b50734c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:25:27.984989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:27.985301 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:27.985602 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.005998 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:28.007187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:28.064286 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1413/2802] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:25:28.072413 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.072694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.072966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.092171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:28.093421 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:28.101656 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1390/2803] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:25:28.106059 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.116068 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09a5c5-447b-4dc5-87fd-fb5e30aa6e3d None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.120612 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.121201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.121481 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.121750 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.122397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:25:28.122698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.124319 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.136637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1414/2804] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:25:28.140907 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.149916 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd1f1c-86d2-4249-8bb7-45ed0db121f8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.154897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.155494 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.155768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.156064 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.156689 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.159089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.187451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1391/2805] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:25:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:25:28.191816 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.201766 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8e46-49a0-4350-a3b4-ebaf50962af4 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.259564 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.260264 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.260542 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.260815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.261475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.263451 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.271692 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:28.286957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1415/2806] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:25:28 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:25:28.291123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.304149 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0425-7116-4251-97bd-6888a49a18c7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.308697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.309297 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.309577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.309845 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.310506 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.312146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.325085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1392/2807] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:25:28.326189 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.336168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c8406-1ebd-4326-be21-ca2076e830c7 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.340733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664deee-cd8d-4d4e-8fff-434ad4adcf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.341697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664deee-cd8d-4d4e-8fff-434ad4adcf95 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.341983 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664deee-cd8d-4d4e-8fff-434ad4adcf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.342434 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664deee-cd8d-4d4e-8fff-434ad4adcf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.343077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664deee-cd8d-4d4e-8fff-434ad4adcf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.344712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664deee-cd8d-4d4e-8fff-434ad4adcf95 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.355869 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1416/2808] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:25:28.360354 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.371167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a8e26-89e8-4441-82a5-8a630b880985 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.375798 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.376767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.377074 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.377347 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] PATH_INFO: `/v3/projects/8486d296c90647febe20f113b6b7c932/users/d77a0998ed6a4c29a959e27d925c7aac/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.392473 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8486d296c90647febe20f113b6b7c932, user_id=d77a0998ed6a4c29a959e27d925c7aac, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.395196 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.409468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1393/2809] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:25:28 2022] PUT /identity/v3/projects/8486d296c90647febe20f113b6b7c932/users/d77a0998ed6a4c29a959e27d925c7aac/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:25:28.414682 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.415040 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.415415 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.434972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:28.436330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:28.499056 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1417/2810] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:25:28.506014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:28.507779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:28.570394 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2e33-fc6f-456f-8bf5-659c77647ee8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:28.574105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a379174-b80e-4602-a8bf-160268e89256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:28.574717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a379174-b80e-4602-a8bf-160268e89256 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:28.574995 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a379174-b80e-4602-a8bf-160268e89256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:28.575267 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a379174-b80e-4602-a8bf-160268e89256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:28.585078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a379174-b80e-4602-a8bf-160268e89256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:28.586480 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a379174-b80e-4602-a8bf-160268e89256 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:28.596768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1394/2811] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:30.295853 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:30.297474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:30.313299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4d8bb-4707-4110-bebd-b54aba129810 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:30.319090 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:30.319914 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:30.320324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:30.320661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:30.322429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:30.388457 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:30.389881 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:30.400174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1418/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:33.874826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:33.876207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:33.877717 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:33.920808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] MFA Rules not processed for user `d77a0998ed6a4c29a959e27d925c7aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:33.922468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:33.973519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:34.018557 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1395/2813] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:25:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:25:34.034847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:34.036569 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:34.141745 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5ab51-eb1c-4d3b-8dff-0d36d7e3958b service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:34.148261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883672a-977b-4523-be8f-eff25d81da74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:34.148889 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883672a-977b-4523-be8f-eff25d81da74 service nova] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:34.149174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883672a-977b-4523-be8f-eff25d81da74 service nova] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:34.149540 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883672a-977b-4523-be8f-eff25d81da74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:34.161188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883672a-977b-4523-be8f-eff25d81da74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:34.162701 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883672a-977b-4523-be8f-eff25d81da74 service nova] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:34.167521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:34.177722 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1419/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:35.025519 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:35.028204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:35.059153 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb973b-d12f-421f-a9c4-e85248d1b28d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:35.068642 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:35.070294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:35.070786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:35.071260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:35.074384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:35.093948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:35.096868 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:35.131315 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1396/2815] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:35.992689 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:35.993176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:35.993478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:36.018023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] MFA Rules not processed for user `d77a0998ed6a4c29a959e27d925c7aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:25:36.019629 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:36.030862 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1420/2816] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:25:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:25:36.358175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:36.370169 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f34d6-be69-48ac-9e19-e51bad0f66c2 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:36.374838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:36.375572 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:36.375859 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:36.376548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:36.379921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:36.390037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:36.391468 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dcc3-8dbb-4301-bcbe-3c0146d8b62d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:36.399713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1397/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:25:46.010638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=4 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:46.396148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=23 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:58.021310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:25:58.022712 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:58.157508 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508148-20ad-4271-9fc7-46b3593794c3 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:25:58.163024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:25:58.163623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:25:58.163898 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:25:58.164200 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:25:58.165885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:25:58.177522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:25:58.179125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:25:58.188637 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1421/2818] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:25:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:26:08.184596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=63 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:59.777841 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:26:59.778365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:26:59.778365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:26:59.808984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] MFA Rules not processed for user `146928ec042742ed8db41b6af73036cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:26:59.810205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:26:59.876184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1398/2819] 10.222.0.27 () {58 vars in 967 bytes} [Sat Oct 1 04:26:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:26:59.917043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:26:59.918421 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:26:59.985343 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fb383-796c-4db4-a7f7-373a6f5b2c0b service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:26:59.990833 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afc96390262a4509ba740d0708ae26aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:26:59.991429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:26:59.991710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:26:59.992008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:27:00.000083 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:27:00.001636 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:27:00.009435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1422/2820] 10.222.0.27 () {60 vars in 1384 bytes} [Sat Oct 1 04:26:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 01 04:27:03.355357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:27:03.356850 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:27:03.371760 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c81796-6b17-4fc2-986d-013ebc74037e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:27:03.377186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:27:03.377800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:27:03.378078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:27:03.378404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:27:03.380508 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:27:03.392205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:27:03.394285 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:27:03.405306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1399/2821] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:27:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:27:06.532080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:27:06.534974 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:27:06.585806 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972f83-af7a-4e28-b4fd-55f655352591 service swift] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:27:06.590269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:27:06.590890 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:27:06.591168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:27:06.591438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] PATH_INFO: `/v3/users/6c9bf0b1ae694dbe95df018449d35b32` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:27:06.592560 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9bf0b1ae694dbe95df018449d35b32)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:27:06.594448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:27:06.640697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9bf0b1ae694dbe95df018449d35b32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.641333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9bf0b1ae694dbe95df018449d35b32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.651809 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9bf0b1ae694dbe95df018449d35b32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.652506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9bf0b1ae694dbe95df018449d35b32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.659815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9bf0b1ae694dbe95df018449d35b32'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.676672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1423/2822] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:27:06 2022] DELETE /identity/v3/users/6c9bf0b1ae694dbe95df018449d35b32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:27:06.844901 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:27:06.855306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d7a6-1617-464d-bd59-bb26dea96215 service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:27:06.913728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:27:06.914365 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:27:06.914645 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:27:06.914914 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] PATH_INFO: `/v3/projects/8e1d95b13899491e8489b0871cec35aa` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:27:06.916070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1d95b13899491e8489b0871cec35aa)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:27:06.918856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:27:06.963682 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1d95b13899491e8489b0871cec35aa', 'request_id': 'req-01d32fd2-df69-4241-84a3-9eb2de5b37ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.971291 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1d95b13899491e8489b0871cec35aa', 'request_id': 'req-01d32fd2-df69-4241-84a3-9eb2de5b37ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.978258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1d95b13899491e8489b0871cec35aa', 'request_id': 'req-01d32fd2-df69-4241-84a3-9eb2de5b37ea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.989025 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] The token cache is being invalidate because project 8e1d95b13899491e8489b0871cec35aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:27:06.989307 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.989920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:06.991441 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1400/2823] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:27:06 2022] DELETE /identity/v3/projects/8e1d95b13899491e8489b0871cec35aa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:27:06.995356 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:27:06.996755 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:27:07.010173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34468-8e75-44ba-b35c-a1e1fd8f50cd admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:27:07.039011 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:07.067501 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:27:07.068187 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:27:07.068478 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:27:07.068739 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] PATH_INFO: `/v3/users/404476b4d1c34226b7bf980b8bb846ea` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:27:07.069868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404476b4d1c34226b7bf980b8bb846ea)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:27:07.071775 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:27:07.115928 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404476b4d1c34226b7bf980b8bb846ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.116590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404476b4d1c34226b7bf980b8bb846ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.123565 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404476b4d1c34226b7bf980b8bb846ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.124488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404476b4d1c34226b7bf980b8bb846ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.132285 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-ab3a3d7b-a243-487b-b5c3-6516378582f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404476b4d1c34226b7bf980b8bb846ea'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.149276 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1424/2824] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:27:06 2022] DELETE /identity/v3/users/404476b4d1c34226b7bf980b8bb846ea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:27:07.316982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:27:07.318520 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:27:07.331503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d32fd2-df69-4241-84a3-9eb2de5b37ea admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:27:07.335144 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:07.389467 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:27:07.390093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:27:07.390363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:27:07.390629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] PATH_INFO: `/v3/projects/b0136dd3d1c144e0b1682729b79f15f2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:27:07.391724 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0136dd3d1c144e0b1682729b79f15f2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:27:07.393637 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:27:07.445242 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0136dd3d1c144e0b1682729b79f15f2', 'request_id': 'req-56b45766-0a79-45fc-9165-1c4e28175f4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.451683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0136dd3d1c144e0b1682729b79f15f2', 'request_id': 'req-56b45766-0a79-45fc-9165-1c4e28175f4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.461466 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0136dd3d1c144e0b1682729b79f15f2', 'request_id': 'req-56b45766-0a79-45fc-9165-1c4e28175f4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.472664 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] The token cache is being invalidate because project b0136dd3d1c144e0b1682729b79f15f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:27:07.472954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.473633 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:27:07.480014 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1401/2825] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:27:07 2022] DELETE /identity/v3/projects/b0136dd3d1c144e0b1682729b79f15f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:27:17.145961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:17.469050 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:02.772156 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:28:02.772756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:28:02.772756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:28:02.792708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] MFA Rules not processed for user `d77a0998ed6a4c29a959e27d925c7aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:28:02.793897 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:28:02.847475 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1425/2826] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:28:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:28:12.840873 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=25 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:48.860676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:28:48.862097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:28:48.941454 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45766-0a79-45fc-9165-1c4e28175f4a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:28:48.945078 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:28:48.945678 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:28:48.945954 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:28:48.946218 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:28:48.948450 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:28:49.031273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:28:49.031273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:28:49.049935 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1402/2827] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:28:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:28:51.908425 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:28:51.918268 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978cb49-c499-4e06-abfb-2f740b9598e2 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:28:51.922027 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:28:51.922614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:28:51.922888 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:28:51.923157 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:28:51.924857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:28:51.938582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:28:51.940086 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:28:51.950726 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1426/2828] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:28:59.047054 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=72 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:00.251273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:00.253115 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:00.267418 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb797da-0a57-48a9-8963-5a9ac71ad725 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:00.273442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:00.274062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:00.274352 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:00.274624 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:00.277043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:00.289693 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:00.292119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:00.307026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1403/2829] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:01.945933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=6 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:08.695527 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:08.697242 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:08.763461 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b44896-5698-4308-bc4f-a572dfa14ad8 service cinder] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:08.767973 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:08.768603 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:08.768882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:08.769178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] PATH_INFO: `/v3/users/d77a0998ed6a4c29a959e27d925c7aac` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:08.770290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77a0998ed6a4c29a959e27d925c7aac)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:08.772255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:08.822980 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77a0998ed6a4c29a959e27d925c7aac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:08.823613 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77a0998ed6a4c29a959e27d925c7aac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:08.830541 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77a0998ed6a4c29a959e27d925c7aac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:08.831185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77a0998ed6a4c29a959e27d925c7aac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:08.837882 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-07da82c6-f57d-40b9-8ace-db5e9c480cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77a0998ed6a4c29a959e27d925c7aac'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:08.855347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1427/2830] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:08 2022] DELETE /identity/v3/users/d77a0998ed6a4c29a959e27d925c7aac => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:09.026476 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.037093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7386-721a-4702-8467-d98c9ed8d421 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.100621 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.101260 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.101538 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.101824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] PATH_INFO: `/v3/projects/8486d296c90647febe20f113b6b7c932` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.102922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8486d296c90647febe20f113b6b7c932)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.105367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.153240 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8486d296c90647febe20f113b6b7c932', 'request_id': 'req-52998829-3436-4d0c-ae52-35f9b8193291'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:09.159327 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8486d296c90647febe20f113b6b7c932', 'request_id': 'req-52998829-3436-4d0c-ae52-35f9b8193291'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:09.167043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8486d296c90647febe20f113b6b7c932', 'request_id': 'req-52998829-3436-4d0c-ae52-35f9b8193291'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:09.177498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] The token cache is being invalidate because project 8486d296c90647febe20f113b6b7c932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:09.177781 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:09.178389 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-52998829-3436-4d0c-ae52-35f9b8193291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:09.180228 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1404/2831] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:09 2022] DELETE /identity/v3/projects/8486d296c90647febe20f113b6b7c932 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:09.185690 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.186045 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.186386 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.244028 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:09.245849 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:09.288173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:09.304506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1428/2832] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:09.312982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.313258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.313553 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.333072 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:09.334280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:09.342178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1405/2833] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:09.346346 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.356396 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbba2f-4632-421a-acc4-054c2a023623 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.360927 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.361515 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.361787 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.362061 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.362700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81721) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:29:09.363002 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.364623 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.376935 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1429/2834] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 01 04:29:09.381817 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.391236 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1830-1b59-4363-8b2e-81df621896f8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.395895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.396532 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.396807 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.397079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.397748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.399644 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.443785 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1406/2835] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:09.445126 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.455440 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85174234-6fe6-45c1-bf55-bfa4252c8e12 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.514855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.515474 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.515756 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.516055 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.516686 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.518605 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.540696 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1430/2836] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:09.545186 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.556498 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbefce7-0839-4662-b6b8-a0c9dfcdc39b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.561178 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.561933 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.562364 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.562799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.564575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.566217 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.577205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1407/2837] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:09.581178 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.591639 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df87ed-830a-4544-92ab-a997150dc0cc admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.596216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb3d9d-3429-41ba-9a8b-7e6cd189327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.596747 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb3d9d-3429-41ba-9a8b-7e6cd189327a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.597024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb3d9d-3429-41ba-9a8b-7e6cd189327a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.597294 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb3d9d-3429-41ba-9a8b-7e6cd189327a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.597952 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb3d9d-3429-41ba-9a8b-7e6cd189327a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.599522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb3d9d-3429-41ba-9a8b-7e6cd189327a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.610216 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1431/2838] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:09.614062 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.624629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e531b-2833-49e3-b88b-a8d3921571c0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.629142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.629778 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.630058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.630334 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] PATH_INFO: `/v3/projects/38bdfccd501647969d13d6c2d0425203/users/bce4fbc6a3684b0b8637797ca6fb2219/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.645280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bdfccd501647969d13d6c2d0425203, user_id=bce4fbc6a3684b0b8637797ca6fb2219, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.648009 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.661031 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1408/2839] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:09 2022] PUT /identity/v3/projects/38bdfccd501647969d13d6c2d0425203/users/bce4fbc6a3684b0b8637797ca6fb2219/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:09.672158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.672443 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.672765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.700619 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] MFA Rules not processed for user `bce4fbc6a3684b0b8637797ca6fb2219`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:09.701814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:09.765899 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1432/2840] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:09.770588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.776397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:09.834470 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c9fe-945c-4f05-a22f-66e7c58b384c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.839118 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.839729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.840040 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.840313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.840943 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.842871 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.873472 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1409/2841] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:09.877732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.888309 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d8fd-3152-451c-a962-bcfd9e1bfda9 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.929961 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:09.945793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.946390 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.946685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.946939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.947618 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.949555 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:09.970939 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1433/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:09 2022] POST /identity/v3/users => generated 309 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:09.973349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:09.983869 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4e399-65c9-463a-8a49-46b903fd0f7b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:09.988738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:09.989368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:09.989647 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:09.989985 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:09.990629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:09.992258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.004861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1410/2843] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:10.008929 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:10.018822 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48d390-194a-4799-a49b-be525047dcf1 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:10.023381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:10.024054 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.024331 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.024597 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] PATH_INFO: `/v3/projects/8588ba062eee480bbf7c9a031f5eac87/users/5bf8e4b3d0cb4d39b96fe883f2fee8d6/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.038815 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8588ba062eee480bbf7c9a031f5eac87, user_id=5bf8e4b3d0cb4d39b96fe883f2fee8d6, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:10.041977 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.054376 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1434/2844] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:10 2022] PUT /identity/v3/projects/8588ba062eee480bbf7c9a031f5eac87/users/5bf8e4b3d0cb4d39b96fe883f2fee8d6/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:10.058818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:10.068863 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b9ba-e770-431a-940d-5bf62bbae320 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:10.123819 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5f53f-200f-4d24-9edd-2751cd87f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:10.124632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5f53f-200f-4d24-9edd-2751cd87f095 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.124906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5f53f-200f-4d24-9edd-2751cd87f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.125171 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5f53f-200f-4d24-9edd-2751cd87f095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.125790 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5f53f-200f-4d24-9edd-2751cd87f095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:10.127357 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5f53f-200f-4d24-9edd-2751cd87f095 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.136799 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1411/2845] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:10.140949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:10.151037 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112f781-8720-4ed2-96c1-7af7c5e7cd08 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:10.155586 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:10.156256 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.156532 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.156800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] PATH_INFO: `/v3/projects/8588ba062eee480bbf7c9a031f5eac87/users/5bf8e4b3d0cb4d39b96fe883f2fee8d6/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.158678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8588ba062eee480bbf7c9a031f5eac87, user_id=5bf8e4b3d0cb4d39b96fe883f2fee8d6, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:10.161330 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.171715 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1435/2846] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:10 2022] PUT /identity/v3/projects/8588ba062eee480bbf7c9a031f5eac87/users/5bf8e4b3d0cb4d39b96fe883f2fee8d6/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:10.182249 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.182548 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.182822 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.209739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] MFA Rules not processed for user `5bf8e4b3d0cb4d39b96fe883f2fee8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:10.210948 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:10.273857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:10.278561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1412/2847] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:10.288731 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:10.290438 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:10.347080 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eabac-7bad-4d09-818a-c984f2277ff2 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:10.350694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba50b66-2de3-45fb-ba44-4d7fadc5a4e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:10.351287 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba50b66-2de3-45fb-ba44-4d7fadc5a4e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.351568 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba50b66-2de3-45fb-ba44-4d7fadc5a4e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.351843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba50b66-2de3-45fb-ba44-4d7fadc5a4e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.361171 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba50b66-2de3-45fb-ba44-4d7fadc5a4e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:10.362589 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba50b66-2de3-45fb-ba44-4d7fadc5a4e8 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.372591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1436/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:10.505804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:10.566824 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebb42d-2270-4030-89a6-94f3f2944f89 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:10.571239 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:10.571857 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.572415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.572685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] PATH_INFO: `/v3/users/bce4fbc6a3684b0b8637797ca6fb2219` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.573791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce4fbc6a3684b0b8637797ca6fb2219)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:10.575698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.621263 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce4fbc6a3684b0b8637797ca6fb2219'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:10.627923 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce4fbc6a3684b0b8637797ca6fb2219'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:10.628578 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce4fbc6a3684b0b8637797ca6fb2219'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:10.635356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce4fbc6a3684b0b8637797ca6fb2219'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:10.635922 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce4fbc6a3684b0b8637797ca6fb2219'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:10.654606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1413/2849] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:10 2022] DELETE /identity/v3/users/bce4fbc6a3684b0b8637797ca6fb2219 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:10.659074 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.659358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.659630 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.679732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:10.681070 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:10.739610 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1437/2850] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:10.749680 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:10.751059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:10.827946 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff951cd-71a4-40ab-b01b-f39415516277 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:10.831668 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:10.832305 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:10.832582 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:10.832852 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:10.842165 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:10.843584 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:10.852926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1414/2851] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:11.115959 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:11.117955 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:11.131166 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f79dd-28b5-41d2-af7d-c3291314a780 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:11.137524 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:11.138174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.138450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.138716 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] PATH_INFO: `/v3/projects/38bdfccd501647969d13d6c2d0425203` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.139902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bdfccd501647969d13d6c2d0425203)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:11.141913 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:11.180271 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:11.191584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bdfccd501647969d13d6c2d0425203', 'request_id': 'req-60de3e60-7ce0-4431-ab47-501c933eb8a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.199121 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bdfccd501647969d13d6c2d0425203', 'request_id': 'req-60de3e60-7ce0-4431-ab47-501c933eb8a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.205299 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bdfccd501647969d13d6c2d0425203', 'request_id': 'req-60de3e60-7ce0-4431-ab47-501c933eb8a6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.216384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] The token cache is being invalidate because project 38bdfccd501647969d13d6c2d0425203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:11.216667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.217289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.218743 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1438/2852] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:11 2022] DELETE /identity/v3/projects/38bdfccd501647969d13d6c2d0425203 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:11.222835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:11.227883 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:11.234209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65e54-ff38-4610-96d6-cf14b874f831 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:11.291202 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:11.291821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.292127 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.292401 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] PATH_INFO: `/v3/users/5bf8e4b3d0cb4d39b96fe883f2fee8d6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.293511 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf8e4b3d0cb4d39b96fe883f2fee8d6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:11.295415 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:11.340626 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf8e4b3d0cb4d39b96fe883f2fee8d6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.347762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf8e4b3d0cb4d39b96fe883f2fee8d6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.348503 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf8e4b3d0cb4d39b96fe883f2fee8d6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.355566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf8e4b3d0cb4d39b96fe883f2fee8d6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.356229 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ef943b49-98a0-4883-9dfd-089aa65a43db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf8e4b3d0cb4d39b96fe883f2fee8d6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.373589 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1415/2853] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:11 2022] DELETE /identity/v3/users/5bf8e4b3d0cb4d39b96fe883f2fee8d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:11.636071 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:11.637538 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:11.652077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3e60-7ce0-4431-ab47-501c933eb8a6 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:11.709072 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:11.709695 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.709972 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.710246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] PATH_INFO: `/v3/projects/8588ba062eee480bbf7c9a031f5eac87` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.711333 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8588ba062eee480bbf7c9a031f5eac87)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:11.713303 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:11.759280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8588ba062eee480bbf7c9a031f5eac87', 'request_id': 'req-915875a1-ccc4-4930-950a-4c64e399ac14'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.769697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8588ba062eee480bbf7c9a031f5eac87', 'request_id': 'req-915875a1-ccc4-4930-950a-4c64e399ac14'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.775989 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8588ba062eee480bbf7c9a031f5eac87', 'request_id': 'req-915875a1-ccc4-4930-950a-4c64e399ac14'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.786043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] The token cache is being invalidate because project 8588ba062eee480bbf7c9a031f5eac87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:11.786329 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.786953 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-915875a1-ccc4-4930-950a-4c64e399ac14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:11.788458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1439/2854] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:11 2022] DELETE /identity/v3/projects/8588ba062eee480bbf7c9a031f5eac87 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:11.794065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.794377 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.794652 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.814766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:11.815982 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:11.876704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1416/2855] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:11.884678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.885032 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.885308 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.904902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:11.906088 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:11.915894 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1440/2856] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 01 04:29:11.920713 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:11.930631 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70c13a-4a80-4e09-a81c-7d0495d33b82 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:11.935889 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:11.937426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.937426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.937426 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.937744 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:29:11.937977 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:11.939561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:11.955010 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1417/2857] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:29:11.956168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:11.965968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd3830-7e19-489f-9a7b-071949ed9849 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:11.970836 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:11.971591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:11.971870 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:11.972336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:11.972971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:11.974880 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.003573 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1441/2858] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:11 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:29:12.008234 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.018632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4d5c0-447c-4db2-9aa5-5b16c2e1f9e3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.024123 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:12.079499 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.080148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.080429 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.080702 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.081343 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.083262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.106978 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1418/2859] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:12 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:12.111163 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.121547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b88ec-5c12-4956-80d7-f87932d78ed8 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.126382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.126968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.127237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.127502 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.128185 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.129748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.139366 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1442/2860] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:12.143013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.153363 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484ab9e-924b-4d19-bba3-b681d474d086 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.158015 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86d1b1-d96a-4462-a48c-1f8ae38cc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.158606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86d1b1-d96a-4462-a48c-1f8ae38cc000 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.158898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86d1b1-d96a-4462-a48c-1f8ae38cc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.159156 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86d1b1-d96a-4462-a48c-1f8ae38cc000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.159793 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86d1b1-d96a-4462-a48c-1f8ae38cc000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.161440 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86d1b1-d96a-4462-a48c-1f8ae38cc000 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.173743 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1419/2861] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:12.177767 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.187563 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fa936-35da-4437-a41c-c663d354ee3b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.192131 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.192765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.193039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.193305 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] PATH_INFO: `/v3/projects/d4ab9f430bfb44b787da7992f6e498ee/users/2d5d8b8290934aeabb9bb02e88787546/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.204098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:12.208863 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ab9f430bfb44b787da7992f6e498ee, user_id=2d5d8b8290934aeabb9bb02e88787546, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.211779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.225413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1443/2862] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:12 2022] PUT /identity/v3/projects/d4ab9f430bfb44b787da7992f6e498ee/users/2d5d8b8290934aeabb9bb02e88787546/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:12.237129 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.237612 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.237714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.265180 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] MFA Rules not processed for user `2d5d8b8290934aeabb9bb02e88787546`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:12.266372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:12.327629 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1420/2863] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:12.332052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.392672 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec43a69-b195-4bee-b6f8-b6c13cbd39a3 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.397296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.397891 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.398168 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.398439 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.399069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.401505 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.427536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1444/2864] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:12 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:12.431383 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.441755 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd99bf-4d43-4ca6-8829-45be5c624df8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.496545 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.497147 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.497422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.497694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.498318 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.500502 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.521069 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1421/2865] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:12 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:12.524960 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.535444 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1560e-e5a8-4d17-8292-bf112b6a5f66 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.540077 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.540661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.540938 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.541283 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.541917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.543487 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.553941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1445/2866] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:12.558017 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.567826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c7a0b-73bb-42fb-a6ad-7eb53bce7948 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.572895 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.573559 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.573828 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.574089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] PATH_INFO: `/v3/projects/ae64031a1f884f328d4c9e47b5da9d97/users/bcd5d6001339496e965e3cd5e8de5e66/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.576222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:12.590918 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae64031a1f884f328d4c9e47b5da9d97, user_id=bcd5d6001339496e965e3cd5e8de5e66, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.593597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.605902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1422/2867] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:12 2022] PUT /identity/v3/projects/ae64031a1f884f328d4c9e47b5da9d97/users/bcd5d6001339496e965e3cd5e8de5e66/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:12.609829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.619553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f8cc-117f-40c6-8385-4964e4ca4f0b admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.677197 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104d6d1-54ce-44e8-beb6-c81e96218c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.677805 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104d6d1-54ce-44e8-beb6-c81e96218c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.678084 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104d6d1-54ce-44e8-beb6-c81e96218c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.678354 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104d6d1-54ce-44e8-beb6-c81e96218c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.679021 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104d6d1-54ce-44e8-beb6-c81e96218c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.680649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104d6d1-54ce-44e8-beb6-c81e96218c5a admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.690024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1446/2868] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:12.694268 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.704860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d54fd-3f9d-423a-a35d-272b9735876b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.709431 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.710079 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.710356 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.710628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] PATH_INFO: `/v3/projects/ae64031a1f884f328d4c9e47b5da9d97/users/bcd5d6001339496e965e3cd5e8de5e66/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.712567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae64031a1f884f328d4c9e47b5da9d97, user_id=bcd5d6001339496e965e3cd5e8de5e66, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.715810 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.726140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1423/2869] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:12 2022] PUT /identity/v3/projects/ae64031a1f884f328d4c9e47b5da9d97/users/bcd5d6001339496e965e3cd5e8de5e66/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:12.736034 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.736322 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.736596 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.764482 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] MFA Rules not processed for user `bcd5d6001339496e965e3cd5e8de5e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:12.765598 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:12.815681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:12.839740 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1447/2870] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:12.851106 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:12.852821 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:12.908603 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3527e-298d-4229-937f-ec4b47cfe797 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:12.912151 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:12.912732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:12.913005 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:12.913270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:12.921926 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:12.923335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:12.933177 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1424/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:13.006467 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:13.016700 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6dd6a-aa0b-4287-b3c9-1187cb2b1989 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:13.020300 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d536-3d5c-45b2-8b51-c14ef4dbbd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:13.020900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d536-3d5c-45b2-8b51-c14ef4dbbd34 service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:13.021176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d536-3d5c-45b2-8b51-c14ef4dbbd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:13.021447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d536-3d5c-45b2-8b51-c14ef4dbbd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:13.077506 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d536-3d5c-45b2-8b51-c14ef4dbbd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:13.078965 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d536-3d5c-45b2-8b51-c14ef4dbbd34 service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:13.087829 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1448/2872] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:18.975551 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:19.036533 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f7dc5-3049-4f02-8a17-6192924e8de8 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:19.041013 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:19.041632 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:19.041905 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:19.042173 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] PATH_INFO: `/v3/users/2d5d8b8290934aeabb9bb02e88787546` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:19.043279 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5d8b8290934aeabb9bb02e88787546)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:19.045209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:19.091400 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5d8b8290934aeabb9bb02e88787546'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.098823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5d8b8290934aeabb9bb02e88787546'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.099438 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5d8b8290934aeabb9bb02e88787546'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.106209 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5d8b8290934aeabb9bb02e88787546'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.106835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5d8b8290934aeabb9bb02e88787546'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.114525 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:19.126567 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1425/2873] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:18 2022] DELETE /identity/v3/users/2d5d8b8290934aeabb9bb02e88787546 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:19.131145 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:19.131606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:19.131723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:19.153697 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:19.154842 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:19.216713 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1449/2874] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:19.226439 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:19.227870 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:19.284026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371337b-751f-4ff0-a315-73e02d9170c9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:19.287560 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:19.288187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:19.288463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:19.288729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:19.297984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:19.299397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:19.309274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1426/2875] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:19.571015 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:19.572543 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:19.584685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e410-8545-4250-87a2-f8b24043a790 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:19.592725 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:19.593358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:19.593633 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:19.593900 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] PATH_INFO: `/v3/projects/d4ab9f430bfb44b787da7992f6e498ee` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:19.595010 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ab9f430bfb44b787da7992f6e498ee)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:19.597748 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:19.644069 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ab9f430bfb44b787da7992f6e498ee', 'request_id': 'req-6a76643f-e224-4179-9596-9862a24f84a0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.652101 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ab9f430bfb44b787da7992f6e498ee', 'request_id': 'req-6a76643f-e224-4179-9596-9862a24f84a0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.658448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ab9f430bfb44b787da7992f6e498ee', 'request_id': 'req-6a76643f-e224-4179-9596-9862a24f84a0'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.669562 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] The token cache is being invalidate because project d4ab9f430bfb44b787da7992f6e498ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:19.669855 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.670488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.671991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1450/2876] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:19 2022] DELETE /identity/v3/projects/d4ab9f430bfb44b787da7992f6e498ee => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:19.676030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:19.685543 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b851b-cf88-4841-a0bf-f5aa4da13868 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:19.740451 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:19.741070 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:19.741345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:19.741614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] PATH_INFO: `/v3/users/bcd5d6001339496e965e3cd5e8de5e66` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:19.742814 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd5d6001339496e965e3cd5e8de5e66)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:19.744782 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:19.789580 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd5d6001339496e965e3cd5e8de5e66'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.797082 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd5d6001339496e965e3cd5e8de5e66'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.797700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd5d6001339496e965e3cd5e8de5e66'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.804575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd5d6001339496e965e3cd5e8de5e66'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.805212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-73ab7e12-5283-4db9-991a-8911b733287f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd5d6001339496e965e3cd5e8de5e66'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:19.822259 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1427/2877] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:19 2022] DELETE /identity/v3/users/bcd5d6001339496e965e3cd5e8de5e66 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:20.091968 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.093463 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:20.107456 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76643f-e224-4179-9596-9862a24f84a0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.111397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:20.167024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.167656 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.167843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.168144 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] PATH_INFO: `/v3/projects/ae64031a1f884f328d4c9e47b5da9d97` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.169269 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae64031a1f884f328d4c9e47b5da9d97)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.171173 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.217097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae64031a1f884f328d4c9e47b5da9d97', 'request_id': 'req-05e165bb-3f91-4192-8d93-f3c15004d6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:20.224097 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae64031a1f884f328d4c9e47b5da9d97', 'request_id': 'req-05e165bb-3f91-4192-8d93-f3c15004d6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:20.230082 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae64031a1f884f328d4c9e47b5da9d97', 'request_id': 'req-05e165bb-3f91-4192-8d93-f3c15004d6fc'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:20.240280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] The token cache is being invalidate because project ae64031a1f884f328d4c9e47b5da9d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:20.240566 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:20.241188 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-05e165bb-3f91-4192-8d93-f3c15004d6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:20.242652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1451/2878] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:20 2022] DELETE /identity/v3/projects/ae64031a1f884f328d4c9e47b5da9d97 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:20.247646 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.248152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.248252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.269838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:20.271029 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:20.279908 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:20.330779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1428/2879] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:20.392238 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.392521 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.392797 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.412125 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:20.413324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:20.421158 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1452/2880] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:20.425258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.435226 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c438-cd9c-45c3-8a22-af9480c884ed None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.439705 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.440328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.440599 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.440864 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.441493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:29:20.441786 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.443349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.454998 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1429/2881] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:29:20.459039 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.468110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44e65-e788-41e2-bc8c-b661ed17611e None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.472729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.473310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.473588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.473860 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.474493 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.476428 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.507694 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1453/2882] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:20.512738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.522610 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b0792-cbe6-4a3c-ac1d-255012884514 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.577591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.578187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.578458 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.578728 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.579350 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.581368 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.602212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1430/2883] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:29:20.606892 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.616922 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254c30b-a8fa-4f0b-b2cf-1ed231ea9438 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.621452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.622041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.622314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.622582 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.623215 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.625096 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.634646 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1454/2884] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:20.638351 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.648274 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b814c9-c221-44cb-8529-429df48fd1ad admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.653611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159e07c-6043-489c-bbf8-2134b5e12940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.654206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159e07c-6043-489c-bbf8-2134b5e12940 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.654478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159e07c-6043-489c-bbf8-2134b5e12940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.654748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159e07c-6043-489c-bbf8-2134b5e12940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.655381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159e07c-6043-489c-bbf8-2134b5e12940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.657057 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159e07c-6043-489c-bbf8-2134b5e12940 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.668126 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1431/2885] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:20.672196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.682245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e354-38a4-4c80-b223-31f4e8bb4516 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.686758 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.687388 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.687665 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.687957 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] PATH_INFO: `/v3/projects/7b18b9d30b4d452b9a2cea91afa30a79/users/18649ad7dbbf45629ac0fdaadd083954/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.702500 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b18b9d30b4d452b9a2cea91afa30a79, user_id=18649ad7dbbf45629ac0fdaadd083954, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.705176 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.718393 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1455/2886] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:20 2022] PUT /identity/v3/projects/7b18b9d30b4d452b9a2cea91afa30a79/users/18649ad7dbbf45629ac0fdaadd083954/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:20.728198 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.728479 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.728750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.755706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] MFA Rules not processed for user `18649ad7dbbf45629ac0fdaadd083954`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:20.756950 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:20.820683 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1432/2887] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:20.825688 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.860450 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:20.889660 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80c376-4e8a-479a-b66e-0f1220300c44 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.894347 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.894949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.895231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.895504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.896155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.898066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:20.924774 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1456/2888] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:20.928898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:20.939437 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0205949-1f7a-4e4a-af6d-83a69e373d7b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:20.944012 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:20.994803 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:20.995402 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:20.995676 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:20.995972 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:20.996658 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:20.998554 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.020756 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1433/2889] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:20 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:21.024765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:21.035381 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fae47-d104-4472-9017-887715bf7208 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:21.039918 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:21.040534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.040814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.041085 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.041723 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:21.043311 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.052943 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1457/2890] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:21.057372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:21.067105 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5f209-3ae1-4948-99ff-81eadfbfacb8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:21.071980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:21.073303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.073583 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.073856 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] PATH_INFO: `/v3/projects/b117f3476ebc4d42ba22ab8fd264bc9b/users/73a562aba4884930b34bb4466e4561ae/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.088386 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b117f3476ebc4d42ba22ab8fd264bc9b, user_id=73a562aba4884930b34bb4466e4561ae, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:21.091044 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.104456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1434/2891] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:21 2022] PUT /identity/v3/projects/b117f3476ebc4d42ba22ab8fd264bc9b/users/73a562aba4884930b34bb4466e4561ae/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:21.108345 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:21.118765 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423adc2-77dd-4155-9a11-676662e7deab admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:21.178270 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4bac4-0c17-4326-b443-5f3cf03df064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:21.178937 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4bac4-0c17-4326-b443-5f3cf03df064 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.179041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4bac4-0c17-4326-b443-5f3cf03df064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.179306 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4bac4-0c17-4326-b443-5f3cf03df064 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.179947 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4bac4-0c17-4326-b443-5f3cf03df064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:21.181525 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4bac4-0c17-4326-b443-5f3cf03df064 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.191534 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1458/2892] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:29:21.195639 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:21.206172 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af2e5a-7990-4a23-bc61-c2b68bf4b6dc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:21.210657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:21.211294 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.211566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.211832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] PATH_INFO: `/v3/projects/b117f3476ebc4d42ba22ab8fd264bc9b/users/73a562aba4884930b34bb4466e4561ae/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.213732 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b117f3476ebc4d42ba22ab8fd264bc9b, user_id=73a562aba4884930b34bb4466e4561ae, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:21.216360 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.226143 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1435/2893] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:21 2022] PUT /identity/v3/projects/b117f3476ebc4d42ba22ab8fd264bc9b/users/73a562aba4884930b34bb4466e4561ae/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:21.235912 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.236227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.236503 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.264785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] MFA Rules not processed for user `73a562aba4884930b34bb4466e4561ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:21.265992 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:21.340031 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1459/2894] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:21.351322 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:21.353142 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:21.409924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62844d-0270-40f3-9c7b-65040e35ec9b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:21.413860 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:21.414462 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.414734 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.415002 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.424449 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:21.425858 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.435666 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1436/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:21.510933 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:21.520449 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f7a53-b37d-4587-8a72-51ccf7a57d06 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:21.523985 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449c656-4307-48eb-9000-86bed7f70d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:21.524584 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449c656-4307-48eb-9000-86bed7f70d8f service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:21.524847 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449c656-4307-48eb-9000-86bed7f70d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:21.525115 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449c656-4307-48eb-9000-86bed7f70d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:21.550915 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:21.582150 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449c656-4307-48eb-9000-86bed7f70d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:21.583575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449c656-4307-48eb-9000-86bed7f70d8f service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:21.592687 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1460/2896] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:24.485966 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:24.546323 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303228ad-b08f-482f-9e9a-f357b5149fb5 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:24.550768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:24.551384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:24.551655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:24.551924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] PATH_INFO: `/v3/users/18649ad7dbbf45629ac0fdaadd083954` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:24.553059 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18649ad7dbbf45629ac0fdaadd083954)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:24.554956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:24.559444 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:24.602325 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18649ad7dbbf45629ac0fdaadd083954'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:24.609300 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18649ad7dbbf45629ac0fdaadd083954'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:24.609906 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18649ad7dbbf45629ac0fdaadd083954'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:24.616715 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18649ad7dbbf45629ac0fdaadd083954'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:24.617270 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18649ad7dbbf45629ac0fdaadd083954'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:24.634390 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1437/2897] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:24 2022] DELETE /identity/v3/users/18649ad7dbbf45629ac0fdaadd083954 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:24.639423 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:24.639901 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:24.640036 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:24.660641 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:24.661857 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:24.720146 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1461/2898] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:24.729757 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:24.731183 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:24.790919 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4c3e-acc1-43c5-9836-3df141d5da6e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:24.794695 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:24.795404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:24.796654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:24.796930 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:24.809026 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:24.810464 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:24.819880 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1438/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:25.083736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:25.085208 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:25.098237 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f520b-55a4-471f-aa33-28bbe780b997 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:25.103030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:25.103705 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.104008 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.104282 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] PATH_INFO: `/v3/projects/7b18b9d30b4d452b9a2cea91afa30a79` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.105483 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b18b9d30b4d452b9a2cea91afa30a79)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:25.107520 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:25.155466 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b18b9d30b4d452b9a2cea91afa30a79', 'request_id': 'req-87fc2c5c-050f-4664-b874-9b523af2d90f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.162751 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b18b9d30b4d452b9a2cea91afa30a79', 'request_id': 'req-87fc2c5c-050f-4664-b874-9b523af2d90f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.169966 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b18b9d30b4d452b9a2cea91afa30a79', 'request_id': 'req-87fc2c5c-050f-4664-b874-9b523af2d90f'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.180155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] The token cache is being invalidate because project 7b18b9d30b4d452b9a2cea91afa30a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:25.180445 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.181104 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.183246 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1462/2900] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:25 2022] DELETE /identity/v3/projects/7b18b9d30b4d452b9a2cea91afa30a79 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:25.187207 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:25.196761 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac8c65-a407-44cb-a7fc-1ea40f24089a service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:25.252264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:25.252892 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.253167 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.253435 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] PATH_INFO: `/v3/users/73a562aba4884930b34bb4466e4561ae` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.254570 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a562aba4884930b34bb4466e4561ae)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:25.256568 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:25.284303 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:25.303750 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a562aba4884930b34bb4466e4561ae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.311575 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a562aba4884930b34bb4466e4561ae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.312212 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a562aba4884930b34bb4466e4561ae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.319201 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a562aba4884930b34bb4466e4561ae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.319823 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ac4de494-2831-477a-85d7-6b3fe3f16977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a562aba4884930b34bb4466e4561ae'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.337804 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1439/2901] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:25 2022] DELETE /identity/v3/users/73a562aba4884930b34bb4466e4561ae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:25.605668 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:25.607116 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:25.619710 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2c5c-050f-4664-b874-9b523af2d90f admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:25.668649 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:25.681196 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:25.682332 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.682614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.682885 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] PATH_INFO: `/v3/projects/b117f3476ebc4d42ba22ab8fd264bc9b` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.684103 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b117f3476ebc4d42ba22ab8fd264bc9b)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:25.685996 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:25.738447 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b117f3476ebc4d42ba22ab8fd264bc9b', 'request_id': 'req-380e7410-4c53-4ac6-b215-34ad92a53084'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.747050 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b117f3476ebc4d42ba22ab8fd264bc9b', 'request_id': 'req-380e7410-4c53-4ac6-b215-34ad92a53084'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.754536 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b117f3476ebc4d42ba22ab8fd264bc9b', 'request_id': 'req-380e7410-4c53-4ac6-b215-34ad92a53084'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.766732 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] The token cache is being invalidate because project b117f3476ebc4d42ba22ab8fd264bc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:25.767007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.767667 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-380e7410-4c53-4ac6-b215-34ad92a53084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:25.769201 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1463/2902] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:25 2022] DELETE /identity/v3/projects/b117f3476ebc4d42ba22ab8fd264bc9b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:25.774193 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.774738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.774738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.795510 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:25.796838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:25.862779 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1440/2903] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:25.871052 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.871336 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.871611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.891795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:25.893030 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:25.900803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1464/2904] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:25.904920 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:25.914264 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9db49-bb41-4e82-8b93-eda4c13c6f6b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:25.919253 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:25.919838 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.920137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.920404 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.921039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:29:25.921335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:25.922902 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:25.934774 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1441/2905] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:29:25.938638 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:25.947652 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227c559-73d0-4373-a333-b97f99ae2d95 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:25.952293 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:25.952875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:25.953154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:25.953429 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:25.954733 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:25.956675 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:25.983997 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1465/2906] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:25 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:25.988221 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:25.998530 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4bf85-67d8-40d0-ade9-eb0b4d3b7d5b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:26.053795 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:26.054398 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:26.054704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:26.054973 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:26.055623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:26.058150 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:26.078482 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1442/2907] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:25 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:29:26.082647 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:26.092814 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4133-c802-4a5e-9aa4-5077b1987dff admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:26.097645 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:26.098239 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:26.098518 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:26.098790 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:26.099452 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:26.101066 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:26.111729 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1466/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 01 04:29:26.115595 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:26.126313 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41396c4-b146-449a-aff3-4155cfb80509 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:26.130787 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112290e0-bed9-43ee-ad3a-14d31c62d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:26.131397 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112290e0-bed9-43ee-ad3a-14d31c62d3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:26.131671 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112290e0-bed9-43ee-ad3a-14d31c62d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:26.131955 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112290e0-bed9-43ee-ad3a-14d31c62d3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:26.132591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112290e0-bed9-43ee-ad3a-14d31c62d3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:26.134152 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112290e0-bed9-43ee-ad3a-14d31c62d3e6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:26.144388 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1443/2909] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:26.148275 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:26.157795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cad93-94cb-45d4-8e05-320d45b2efb0 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:26.162422 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:26.163154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:26.163431 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:26.163704 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] PATH_INFO: `/v3/projects/e1a67163f11943bdb48ef8ea685a570f/users/58c794d5525c42e1847ded331496d34d/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:26.179681 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a67163f11943bdb48ef8ea685a570f, user_id=58c794d5525c42e1847ded331496d34d, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:26.183024 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:26.195803 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1467/2910] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:26 2022] PUT /identity/v3/projects/e1a67163f11943bdb48ef8ea685a570f/users/58c794d5525c42e1847ded331496d34d/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:26.206241 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:26.206521 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:26.206789 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:26.226442 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:26.234881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] MFA Rules not processed for user `58c794d5525c42e1847ded331496d34d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:26.236767 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:26.301517 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1444/2911] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:26.312230 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:26.314012 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:26.369651 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327f825-ec6c-4ff4-a049-1d7f0f1e2b28 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:26.373227 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33beb-d473-466f-abcd-3dd9ac6fd24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c891f90f1b4b508752dfebc1de3589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:26.373823 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33beb-d473-466f-abcd-3dd9ac6fd24d service cinder] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:26.374098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33beb-d473-466f-abcd-3dd9ac6fd24d service cinder] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:26.374365 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33beb-d473-466f-abcd-3dd9ac6fd24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:26.382627 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33beb-d473-466f-abcd-3dd9ac6fd24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:26.384064 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33beb-d473-466f-abcd-3dd9ac6fd24d service cinder] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:26.392617 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1468/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:29.388700 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:29.449659 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b8f33-836c-45e3-a019-9b748914a2b2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:29.454184 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:29.454809 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:29.455088 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:29.455361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] PATH_INFO: `/v3/users/58c794d5525c42e1847ded331496d34d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:29.456501 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c794d5525c42e1847ded331496d34d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:29.458524 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:29.503888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c794d5525c42e1847ded331496d34d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:29.511456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c794d5525c42e1847ded331496d34d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:29.512102 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c794d5525c42e1847ded331496d34d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:29.519164 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c794d5525c42e1847ded331496d34d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:29.519808 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c794d5525c42e1847ded331496d34d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:29.536607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1445/2913] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:29:29 2022] DELETE /identity/v3/users/58c794d5525c42e1847ded331496d34d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:29.541382 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:29.541850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:29.541949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:29.561023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:29.562221 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:29.575971 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:29.622818 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1469/2914] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:29.632617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:29.634036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:29.657199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:29.694058 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782782f-dc53-4d9c-857a-c1647f0484c5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:29.697698 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a5952-dd54-4a94-931a-88c28bc07fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:29.698302 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5952-dd54-4a94-931a-88c28bc07fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:29.698577 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5952-dd54-4a94-931a-88c28bc07fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:29.698847 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5952-dd54-4a94-931a-88c28bc07fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:29.707566 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a5952-dd54-4a94-931a-88c28bc07fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:29.709019 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a5952-dd54-4a94-931a-88c28bc07fb2 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:29.718232 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1446/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:29.975289 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:29.976811 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:29.989708 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21eda2-e214-4528-a1ca-7ea27a7be67c None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:29.994949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:29.995591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:29.995868 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:29.996174 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] PATH_INFO: `/v3/projects/e1a67163f11943bdb48ef8ea685a570f` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:29.997310 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a67163f11943bdb48ef8ea685a570f)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.000263 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.049290 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a67163f11943bdb48ef8ea685a570f', 'request_id': 'req-e5f23487-08af-4384-b8f6-411f603acee6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:30.057043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a67163f11943bdb48ef8ea685a570f', 'request_id': 'req-e5f23487-08af-4384-b8f6-411f603acee6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:30.063370 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a67163f11943bdb48ef8ea685a570f', 'request_id': 'req-e5f23487-08af-4384-b8f6-411f603acee6'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:30.073531 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] The token cache is being invalidate because project e1a67163f11943bdb48ef8ea685a570f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:29:30.073820 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:30.074448 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e5f23487-08af-4384-b8f6-411f603acee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:29:30.075958 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1470/2916] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:29:29 2022] DELETE /identity/v3/projects/e1a67163f11943bdb48ef8ea685a570f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:30.080835 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e84342-1917-4209-aa48-65ad25155960 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.081119 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e84342-1917-4209-aa48-65ad25155960 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.081393 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e84342-1917-4209-aa48-65ad25155960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.102004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-72e84342-1917-4209-aa48-65ad25155960 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:30.103199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-72e84342-1917-4209-aa48-65ad25155960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:30.161113 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1447/2917] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:30.170588 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.170875 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.171149 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.191795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:30.193043 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:30.200976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1471/2918] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:30.205273 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e84342-1917-4209-aa48-65ad25155960 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.215497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e84342-1917-4209-aa48-65ad25155960 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.220112 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.220706 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.220981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.221248 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.221879 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 01 04:29:30.222175 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.223748 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.235561 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1448/2919] 10.222.0.27 () {58 vars in 1153 bytes} [Sat Oct 1 04:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 01 04:29:30.239554 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.248507 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608afdd-79ba-4deb-ad40-66e513ab1438 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.253320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.253902 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.254170 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.254435 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.255060 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.256962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.283314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1472/2920] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:30 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 01 04:29:30.287361 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.297655 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cb090-6cd1-4126-b4ff-57aea8a64899 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.351367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.351981 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.352258 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.352527 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.353148 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.355607 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.377372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1449/2921] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:30 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:30.381494 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.392120 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec69f5-0608-4553-b418-892184fd2f59 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.396655 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.397247 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.397522 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.397785 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.398414 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.400006 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.409850 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1473/2922] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:30.413597 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.423739 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0efa-4ee7-4eac-841e-8d1e0029937a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.428328 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee604d-a59c-44e1-b489-ff4d81f04a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.428912 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee604d-a59c-44e1-b489-ff4d81f04a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.429187 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee604d-a59c-44e1-b489-ff4d81f04a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.429456 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee604d-a59c-44e1-b489-ff4d81f04a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.430085 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee604d-a59c-44e1-b489-ff4d81f04a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.431651 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee604d-a59c-44e1-b489-ff4d81f04a4d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.442463 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1450/2923] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:30.446272 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.455793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbe945-a6d0-4cf3-bae9-7b05ffdaa723 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.460320 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.460941 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.461217 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.461488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] PATH_INFO: `/v3/projects/d44ae23959e347ec86273cf9ba878a8a/users/6044118e7a4448dbac3b8f34dd7a773a/roles/dd4261a805134646858c0ad93ba486fd` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.475433 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44ae23959e347ec86273cf9ba878a8a, user_id=6044118e7a4448dbac3b8f34dd7a773a, role_id=dd4261a805134646858c0ad93ba486fd)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.478079 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.491291 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1474/2924] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:30 2022] PUT /identity/v3/projects/d44ae23959e347ec86273cf9ba878a8a/users/6044118e7a4448dbac3b8f34dd7a773a/roles/dd4261a805134646858c0ad93ba486fd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:29:30.496731 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20f79-30c9-4ac3-91e5-fd84067cb04f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.497039 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20f79-30c9-4ac3-91e5-fd84067cb04f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.497338 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20f79-30c9-4ac3-91e5-fd84067cb04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.515791 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f0a20f79-30c9-4ac3-91e5-fd84067cb04f None None] MFA Rules not processed for user `84677dff283a4e27afa450cf4325d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:30.517036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f0a20f79-30c9-4ac3-91e5-fd84067cb04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:30.540034 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:30.575367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1451/2925] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:30.584949 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:30.586606 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:30.629781 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:30.645228 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19e6cb-309c-48a9-b1b5-31e6bc3b6a67 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:30.649177 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:30.649793 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:30.650112 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:30.650469 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:30.659454 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:30.660906 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:30.670779 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1475/2926] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:29:34.606714 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac519d-7662-4132-8049-91df863560d1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:34.607205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac519d-7662-4132-8049-91df863560d1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:34.607306 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac519d-7662-4132-8049-91df863560d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:34.637205 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1dac519d-7662-4132-8049-91df863560d1 None None] MFA Rules not processed for user `6044118e7a4448dbac3b8f34dd7a773a`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:34.638428 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1dac519d-7662-4132-8049-91df863560d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:34.709160 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1452/2927] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:34.713976 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:34.723763 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e41a27-0cc1-4a05-b1ee-9999b975ac09 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:34.728458 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:34.729245 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:34.729583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:34.729923 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:34.730614 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:34.732761 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:34.765110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1476/2928] 10.222.0.27 () {60 vars in 1153 bytes} [Sat Oct 1 04:29:34 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:34.766345 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac519d-7662-4132-8049-91df863560d1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:34.777738 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac519d-7662-4132-8049-91df863560d1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:34.838772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:34.839427 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:34.839681 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:34.839983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:34.840623 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:34.842701 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:34.864492 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1453/2929] 10.222.0.27 () {60 vars in 1144 bytes} [Sat Oct 1 04:29:34 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 01 04:29:34.868808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:34.880470 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9bb97-f678-48bc-96ce-4c464f7167ef admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:34.885669 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:34.886323 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:34.886579 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:34.886845 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:34.887485 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:34.889154 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:34.900736 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1477/2930] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:34.904983 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:34.915140 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922adcf-0e1d-4dd2-aaa0-bf700bce0e9f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:34.920381 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:34.921036 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:34.921310 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:34.921576 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] PATH_INFO: `/v3/projects/ac9358c4c5f6484993b2ca7f8e5f415d/users/6f7a3c1b9b674b2b8c38813f49d21b40/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:34.937311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9358c4c5f6484993b2ca7f8e5f415d, user_id=6f7a3c1b9b674b2b8c38813f49d21b40, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:34.940065 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:34.954298 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1454/2931] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:34 2022] PUT /identity/v3/projects/ac9358c4c5f6484993b2ca7f8e5f415d/users/6f7a3c1b9b674b2b8c38813f49d21b40/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:34.958413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:34.968661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eec7b-765c-45bc-9b22-8508d7371561 admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:35.026398 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763549fc-7971-442b-acbd-7ddee35512d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:35.027007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763549fc-7971-442b-acbd-7ddee35512d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:35.027292 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763549fc-7971-442b-acbd-7ddee35512d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:35.027559 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763549fc-7971-442b-acbd-7ddee35512d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:35.028229 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763549fc-7971-442b-acbd-7ddee35512d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:35.029843 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763549fc-7971-442b-acbd-7ddee35512d3 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:35.039218 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1478/2932] 10.222.0.27 () {58 vars in 1122 bytes} [Sat Oct 1 04:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 01 04:29:35.044071 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:35.054537 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e2b8-82be-4db0-84b0-1d7c6a01b6db admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:35.059951 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:35.060602 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:35.060881 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:35.061154 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] PATH_INFO: `/v3/projects/ac9358c4c5f6484993b2ca7f8e5f415d/users/6f7a3c1b9b674b2b8c38813f49d21b40/roles/8fdee6d92c844466842df5998d45def4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:35.063060 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9358c4c5f6484993b2ca7f8e5f415d, user_id=6f7a3c1b9b674b2b8c38813f49d21b40, role_id=8fdee6d92c844466842df5998d45def4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:35.065730 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:35.075854 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1455/2933] 10.222.0.27 () {60 vars in 1483 bytes} [Sat Oct 1 04:29:35 2022] PUT /identity/v3/projects/ac9358c4c5f6484993b2ca7f8e5f415d/users/6f7a3c1b9b674b2b8c38813f49d21b40/roles/8fdee6d92c844466842df5998d45def4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:29:39.419924 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcd09-f17f-4c51-8927-48ac7a1e48ae None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:39.420488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcd09-f17f-4c51-8927-48ac7a1e48ae None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:39.420488 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dcd09-f17f-4c51-8927-48ac7a1e48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:39.451547 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-268dcd09-f17f-4c51-8927-48ac7a1e48ae None None] MFA Rules not processed for user `6f7a3c1b9b674b2b8c38813f49d21b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:39.452950 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-268dcd09-f17f-4c51-8927-48ac7a1e48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:39.549098 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1479/2934] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:39.565262 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:39.567425 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:39.583206 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:39.660081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388031-c06c-4bfe-80dd-2082de22d39a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:39.665820 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:39.666606 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:39.666984 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:39.667367 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:39.732861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:39.734483 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:39.745729 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1456/2935] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:40.736316 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] REQUEST_METHOD: `POST` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:40.736828 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:40.736962 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:40.756004 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.auth.core [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] MFA Rules not processed for user `6044118e7a4448dbac3b8f34dd7a773a`. Rule list: `[]` (Enabled: `True`). {{(pid=81721) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 01 04:29:40.757231 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:40.764100 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1480/2936] 10.222.0.27 () {58 vars in 958 bytes} [Sat Oct 1 04:29:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 01 04:29:49.740083 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=51 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:50.750986 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:53.560008 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:53.561497 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:53.640873 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8678e24-d718-418b-8503-db490840fea5 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:53.645929 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:53.646541 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:53.646818 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:53.647089 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:53.648832 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:53.661030 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:53.662596 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:53.672654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1457/2937] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:29:55.361990 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:29:55.420374 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287a82a-90d0-40fe-b595-d6a8f0e12423 None None] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:29:55.424678 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:29:55.425296 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:29:55.425575 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:29:55.425846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:29:55.427590 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:29:55.438005 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:29:55.439495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:29:55.448001 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1481/2938] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:29:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:30:00.373898 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:30:00.376330 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:30:00.393222 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856081c2-c99c-4a5b-89e9-560e918e780c service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:30:00.398552 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:30:00.399146 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:30:00.399420 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:30:00.399685 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:30:00.401422 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:30:00.414649 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:30:00.416478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:30:00.428292 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1458/2939] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:30:03.110611 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:30:03.112029 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:30:03.122155 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebea0fa-9a70-493f-b0a3-55fd6ba3ae56 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:30:03.125991 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:30:03.126574 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:30:03.126846 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:30:03.127110 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:30:03.135978 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:30:03.137375 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:30:03.146402 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1482/2940] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:30:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 01 04:30:10.424247 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=38 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:13.142417 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=32 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:02.538674 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:31:02.540099 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:31:02.554459 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1679f-9499-44ce-a0dd-9b35ab4fd20c service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:31:02.559980 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:31:02.560797 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:31:02.561081 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:31:02.561349 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:31:02.563037 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:31:02.575185 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:31:02.576800 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:31:02.586654 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1459/2941] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:31:12.582283 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:32:12.401504 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:32:12.410511 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f1b06-7a2a-41cf-a01e-f89f1a33f7ed service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:32:12.414128 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:32:12.414721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:32:12.414993 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:32:12.415261 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:32:12.416930 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:32:12.426161 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:32:12.427561 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:32:12.435315 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1483/2942] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:32:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:32:12.552694 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:32:12.566410 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc78b63-ad1c-4efe-951f-2646fb5dd506 service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:32:12.570485 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:32:12.571493 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:32:12.572111 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:32:12.572762 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:32:12.574897 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:32:12.592697 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:32:12.594833 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:32:12.604826 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1460/2943] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:32:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:32:13.701397 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:32:13.710017 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4380304-b7c5-46f5-b64a-e4db13934b93 service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:32:13.713583 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf20962b404013898ef0d093cf53ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:32:13.714255 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:32:13.714553 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:32:13.714824 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:32:13.716533 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:32:13.729642 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:32:13.731041 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:32:13.742384 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1484/2944] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:32:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:32:22.600045 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:32:23.737314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=12 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:33:34.897617 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:33:34.912900 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b33cc6-ce8f-4c49-9199-5f52b1c979b7 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:33:34.918956 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '424b048ef3454b8597a80c0f605b4c64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:33:34.919588 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:33:34.920261 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:33:34.920453 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:33:34.922374 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:33:34.935384 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:33:34.937093 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:33:34.948924 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1461/2945] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:33:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:33:43.766385 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:33:43.793058 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68974-ec1e-46d2-ab4d-f3c25c6f890f service neutron] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:33:43.799243 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:33:43.800007 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] REQUEST_METHOD: `GET` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:33:43.800324 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:33:43.800661 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:33:43.803795 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:33:43.816854 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:33:43.818727 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:33:43.830023 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1485/2946] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:33:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:33:44.943921 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:33:46.928199 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:33:47.000614 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5475a6-4d43-4f22-af21-9a7c23617ce1 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:33:47.006223 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:33:47.006861 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:33:47.007137 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:33:47.007408 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] PATH_INFO: `/v3/users/6044118e7a4448dbac3b8f34dd7a773a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:33:47.008611 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6044118e7a4448dbac3b8f34dd7a773a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:33:47.010704 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:33:47.063710 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6044118e7a4448dbac3b8f34dd7a773a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.072097 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6044118e7a4448dbac3b8f34dd7a773a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.072709 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6044118e7a4448dbac3b8f34dd7a773a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.079684 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6044118e7a4448dbac3b8f34dd7a773a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.080369 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6044118e7a4448dbac3b8f34dd7a773a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.097335 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1462/2947] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:33:46 2022] DELETE /identity/v3/users/6044118e7a4448dbac3b8f34dd7a773a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:33:47.265280 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:33:47.275808 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9872-4b96-4526-8ce4-4965c552ddb5 service placement] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:33:47.332358 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:33:47.332916 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:33:47.333195 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:33:47.333495 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] PATH_INFO: `/v3/projects/d44ae23959e347ec86273cf9ba878a8a` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:33:47.334599 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44ae23959e347ec86273cf9ba878a8a)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:33:47.336530 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:33:47.381838 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44ae23959e347ec86273cf9ba878a8a', 'request_id': 'req-e1b6ff89-18e7-491a-a2e6-131e6f956fad'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.388917 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44ae23959e347ec86273cf9ba878a8a', 'request_id': 'req-e1b6ff89-18e7-491a-a2e6-131e6f956fad'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.395140 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44ae23959e347ec86273cf9ba878a8a', 'request_id': 'req-e1b6ff89-18e7-491a-a2e6-131e6f956fad'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.405314 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] The token cache is being invalidate because project d44ae23959e347ec86273cf9ba878a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:33:47.405604 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.406235 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.407698 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1486/2948] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:33:47 2022] DELETE /identity/v3/projects/d44ae23959e347ec86273cf9ba878a8a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:33:47.412353 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:33:47.413945 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:33:47.426772 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826bc3-8225-4587-9e4c-dce370f549fe admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:33:47.481752 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:33:47.482378 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:33:47.482657 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:33:47.482931 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] PATH_INFO: `/v3/users/6f7a3c1b9b674b2b8c38813f49d21b40` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:33:47.484091 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7a3c1b9b674b2b8c38813f49d21b40)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:33:47.486004 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:33:47.507529 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:33:47.532648 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7a3c1b9b674b2b8c38813f49d21b40'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.540766 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7a3c1b9b674b2b8c38813f49d21b40'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.541372 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7a3c1b9b674b2b8c38813f49d21b40'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.548252 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7a3c1b9b674b2b8c38813f49d21b40'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.548872 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7a3c1b9b674b2b8c38813f49d21b40'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.566591 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1463/2949] 10.222.0.27 () {58 vars in 1224 bytes} [Sat Oct 1 04:33:47 2022] DELETE /identity/v3/users/6f7a3c1b9b674b2b8c38813f49d21b40 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 01 04:33:47.744840 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Authenticating user token {{(pid=81721) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:33:47.746389 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.fernet_utils [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81721) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:33:47.760484 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ff89-18e7-491a-a2e6-131e6f956fad admin admin] Validating token access rules against request {{(pid=81721) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:33:47.817550 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84677dff283a4e27afa450cf4325d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05869adb61214f878dfb2cd13c841b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81721) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:33:47.818133 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:33:47.818413 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:33:47.818685 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] PATH_INFO: `/v3/projects/ac9358c4c5f6484993b2ca7f8e5f415d` {{(pid=81721) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:33:47.819800 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9358c4c5f6484993b2ca7f8e5f415d)` {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:33:47.821721 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] RBAC: Authorization granted {{(pid=81721) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:33:47.846193 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:33:47.872909 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9358c4c5f6484993b2ca7f8e5f415d', 'request_id': 'req-2259cd65-fccb-4a17-a947-43445d3d6e59'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.880391 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9358c4c5f6484993b2ca7f8e5f415d', 'request_id': 'req-2259cd65-fccb-4a17-a947-43445d3d6e59'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.886591 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9358c4c5f6484993b2ca7f8e5f415d', 'request_id': 'req-2259cd65-fccb-4a17-a947-43445d3d6e59'} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.897160 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] The token cache is being invalidate because project ac9358c4c5f6484993b2ca7f8e5f415d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81721) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 01 04:33:47.897441 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.898065 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG keystone.notifications [None req-2259cd65-fccb-4a17-a947-43445d3d6e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81721) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 01 04:33:47.899512 dv-cinder-860044-1-smb devstack@keystone.service[81721]: [pid: 81721|app: 0|req: 1487/2950] 10.222.0.27 () {58 vars in 1233 bytes} [Sat Oct 1 04:33:47 2022] DELETE /identity/v3/projects/ac9358c4c5f6484993b2ca7f8e5f415d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 01 04:33:57.563191 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:33:57.893717 dv-cinder-860044-1-smb devstack@keystone.service[81721]: DEBUG dbcounter [-] [81721] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:36:08.775214 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 01 04:36:08.776699 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:36:08.917376 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac4dcd-0829-4862-9b42-b116e7e37d51 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 01 04:36:08.975280 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c396bae46a64f1b8ca950fb8d7a2770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f75e1b358f84e6eaa27c44900970892', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 01 04:36:08.975890 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 01 04:36:08.976204 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 01 04:36:08.976478 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 01 04:36:08.978768 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 01 04:36:08.990043 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 01 04:36:08.991628 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67fa03-e8a0-4204-af76-01c78da222b7 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 01 04:36:09.002311 dv-cinder-860044-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1464/2951] 10.222.0.27 () {60 vars in 1365 bytes} [Sat Oct 1 04:36:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 01 04:36:18.997888 dv-cinder-860044-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}